Search the web
Sign In
New User? Sign Up
simpoint
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Want your group to be featured on the Yahoo! Groups website? Add a group photo to Flickr.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
Error: FVParser::nextLine() lines are too long for buffer   Message List  
Reply | Forward Message #28 of 119 |
Re: [simpoint] Error: FVParser::nextLine() lines are too long for buffer

Oops, that's the same error as before. Weird I thought it was different
for a sec.

Marek

Marek Olszewski wrote:
> Great, thanks for the quick response.
>
> I'm using the sparse representation and I don't have any superfluous
> spaces. My vectors are simply that big :(
>
> I tried applying your patch on my 3.1 tree and it seemed to fail. I
> didn't look too much into why but it seemed to apply fine on a fresh
> 3.2 download. However, I'm not sure if it fixed the problem. I now
> get an "Error: FVParser::nextLine() lines are too long for buffer" error.
>
> Cheers,
>
> Marek
>
>
> Greg Hamerly wrote:
>> The SimPoint parser is really set up to parse one line at a time,
>> there is
>> no way to spread vectors across multiple lines and have SimPoint read
>> them.
>>
>> How long are the vectors you are having difficulty with, in terms of
>> number of characters on a line? The maximum SimPoint will read is
>> currently set at 1024 * 1024 - 1 = 1,048,575 characters per line. You
>> can
>> adjust this in the file analysiscode/FVParser.cpp, in the method
>> nextLine() -- just increase the constant BUF_SIZE to accomodate what you
>> need.
>>
>> Also, I have attached a patch to the SimPoint 3.1 codebase that
>> should fix
>> this problem, though it might make parsing a little slower.
>>
>> Are you using a sparse representation, so that you do not put counts of
>> zero explicitly in the vector? If you're not using one, a sparse
>> representation would probably fix the problem you are seeing.
>>
>> Also, if you have a lot of spaces on a line that describes a vector, you
>> would want to eliminate all unnecessary spaces.
>>
>>
>> - Greg Hamerly
>>
>>
>> On Tue, 23 May 2006, olszewski_marek wrote:
>>
>> > Hi,
>> >
>> > I've got two counter acting constraints when generating my own custom
>> > vectors for Simpoint to work on. 1) My vector generating code runs
>> > out of memory when I decrease the interval size, and 2) I get the
>> > above error in Simpoint when I increase it.
>> >
>> > Is there a way to specify a vector on more than one line?
>> >
>> > Thanks,
>> >
>> > Marek
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > Yahoo! Groups Links
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>>
>> SPONSORED LINKS
>> Affiliate program software
>>
<http://groups.yahoo.com/gads?t=ms&k=Affiliate+program+software&w1=Affiliate+pro\
gram+software&w2=Construction+software+program&w3=Medical+software+program&w4=Ac\
counting+software+program&w5=Estate+program+real+software&w6=Software+developmen\
t+program&c=6&s=198&.sig=9KaWuy6FKnRHLoW5F2y04Q
>
>> Construction software program
>>
<http://groups.yahoo.com/gads?t=ms&k=Construction+software+program&w1=Affiliate+\
program+software&w2=Construction+software+program&w3=Medical+software+program&w4\
=Accounting+software+program&w5=Estate+program+real+software&w6=Software+develop\
ment+program&c=6&s=198&.sig=F3LkPjhe1MkJ4Fq3QQZwUA
>
>> Medical software program
>>
<http://groups.yahoo.com/gads?t=ms&k=Medical+software+program&w1=Affiliate+progr\
am+software&w2=Construction+software+program&w3=Medical+software+program&w4=Acco\
unting+software+program&w5=Estate+program+real+software&w6=Software+development+\
program&c=6&s=198&.sig=AwyI7nQBuf_OuJksGRgsXA
>
>>
>> Accounting software program
>>
<http://groups.yahoo.com/gads?t=ms&k=Accounting+software+program&w1=Affiliate+pr\
ogram+software&w2=Construction+software+program&w3=Medical+software+program&w4=A\
ccounting+software+program&w5=Estate+program+real+software&w6=Software+developme\
nt+program&c=6&s=198&.sig=VzCxLFHTZiHmXsWEP_djZQ
>
>> Estate program real software
>>
<http://groups.yahoo.com/gads?t=ms&k=Estate+program+real+software&w1=Affiliate+p\
rogram+software&w2=Construction+software+program&w3=Medical+software+program&w4=\
Accounting+software+program&w5=Estate+program+real+software&w6=Software+developm\
ent+program&c=6&s=198&.sig=lMTrEr4oqbyRycvw8--w5g
>
>> Software development program
>>
<http://groups.yahoo.com/gads?t=ms&k=Software+development+program&w1=Affiliate+p\
rogram+software&w2=Construction+software+program&w3=Medical+software+program&w4=\
Accounting+software+program&w5=Estate+program+real+software&w6=Software+developm\
ent+program&c=6&s=198&.sig=DOR5xh8pu5s-DHxW2MQDrA
>
>>
>>
>>
>> ------------------------------------------------------------------------
>> YAHOO! GROUPS LINKS
>>
>> * Visit your group "simpoint
>> <http://groups.yahoo.com/group/simpoint>" on the web.
>> * To unsubscribe from this group, send an email to:
>> simpoint-unsubscribe@yahoogroups.com
>> <mailto:simpoint-unsubscribe@yahoogroups.com?subject=Unsubscribe>
>> * Your use of Yahoo! Groups is subject to the Yahoo!
>> Terms of
>> Service <http://docs.yahoo.com/info/terms/>.
>>
>>
>> ------------------------------------------------------------------------
>>
>> ------------------------------------------------------------------------
>>
>> *** FVParser.cpp 2006-05-23 15:51:54.000000000 -0500
>> --- ../../SimPoint.3.1/analysiscode/FVParser.cpp 2005-06-30
>> 15:20:51.000000000 -0500
>> ***************
>> *** 103,123 ****
>> buffer[0] = '\0';
>> do {
>> fgets(buffer, BUF_SIZE, input);
>> ! } while ((! eof()) && (('\0' == buffer[0]) || ('T' !=
>> buffer[0])));
>> if (eof()) { return false; }
>> - line.append(buffer);
>> - - while ((! eof()) && (strlen(buffer) == BUF_SIZE - 1) && ('\n'
>> != buffer[BUF_SIZE - 1])) {
>> - fgets(buffer, BUF_SIZE, input);
>> - line.append(buffer);
>> - }
>> - #if (__GNUC__ >= 3)
>> ! istringstream parser(line);
>> #else
>> ! istrstream parser(line);
>> #endif
>> char t;
>> --- 103,118 ----
>> buffer[0] = '\0';
>> do {
>> fgets(buffer, BUF_SIZE, input);
>> ! } while ((! eof()) && ((strlen(buffer) == 0) || ('T' !=
>> buffer[0])));
>> ! Utilities::check(strlen(buffer) != BUF_SIZE - 1,
>> ! "FVParser::nextLine() lines are too long for buffer");
>> if (eof()) { return false; }
>> #if (__GNUC__ >= 3)
>> ! istringstream parser(buffer);
>> #else
>> ! istrstream parser(buffer, strlen(buffer));
>> #endif
>> char t;
>>
>



Wed May 24, 2006 1:22 am

olszewski_marek
Offline Offline
Send Email Send Email

Forward
Message #28 of 119 |
Expand Messages Author Sort by Date

Hi, I've got two counter acting constraints when generating my own custom vectors for Simpoint to work on. 1) My vector generating code runs out of memory...
olszewski_marek
Offline Send Email
May 23, 2006
7:55 pm

The SimPoint parser is really set up to parse one line at a time, there is no way to spread vectors across multiple lines and have SimPoint read them. How...
Greg Hamerly
ghamerly
Offline Send Email
May 23, 2006
8:59 pm

Great, thanks for the quick response. I'm using the sparse representation and I don't have any superfluous spaces. My vectors are simply that big :( I tried...
Marek Olszewski
olszewski_marek
Offline Send Email
May 23, 2006
11:59 pm

Oops, that's the same error as before. Weird I thought it was different for a sec. Marek...
Marek Olszewski
olszewski_marek
Offline Send Email
May 24, 2006
1:24 am
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help