Lucas,

Below is a comment on your matching "to.", and a suggestion for some tests you
might want to make.

Sorry, but your requirements are confusing. You started out with the statement
that matching "-TO-" instead of just "TO" was undesirable, then you settled for
a search pattern, that would never match a "TO" inside hyphens. Furthermore, you
later wondered why "\bto\b" would include the hyphen in a match (below).


I suggest you paste the following string into a new document, and try the
different search patterns proposed on the string, to see which matches you want,
and don't want:

The Plain search (non-regexp) does not find words adjacent to $ or #. This is
either an esoteric feature, or a bug.

!to @to %to ^to &to *to (to)to-to+to =to [to {to ]to }to |to \to ;to :to 'to
"to,to.to /to <to >to ?to to

Plain text search for WHOLE words misses the following (Feature? or Bug?)
#to $to

Both plain text and \bto\b miss the following:
"_to "


^!Find "to" CIS
^!Find "\bto\b" RIS
^!Find "(\R| )(TO)(\R| )"RSTI2
;the last of these three find commands severely restricts what it can find. This
is desirable, if you want to exclude all other delimiters around "TO".


SCROLL DOWN

--- In ntb-clips@yahoogroups.com, "Lucas" <lucas.jfelix@...> wrote:
> The cenario i got here is:
> Select the "TO" but only when it is arround spaces and only the word "TO", it
shouldnt select the spaces aswell.


> For some reason that i havent understand yet, ^!Find "\bTO\b" RIS
> also selects "TO" when it is has dot (.) or (-) arround the TO!

This implies, that your dot "." and hyphen "-" may be something other than the
standard Ansi set.

Character "." should have character code "46"
Character "-" should have character code "45"

Here is a little clip to test for the proper character code:

H="Get Char Code"
^!Set %c%=^$GetSelection$
^!Set %d%=^$CharToDec(^%c%)$
^!Info [l]Character "^%c%" has character code "^%d%"


If your character code comes out the same as above, then perhaps you should
reinstall NoteTab. Sometimes some file NoteTab uses gets corrupted, and NoteTab
develops funny quirks.


Cheers


Eb

Hi Flo,

Thanks for the explanation about \b, now i get it.

About what am i doing really:

I'm working on a project here to indent/organize my COBOL source code.
Because COBOL is all about patterns for example:

All the reserved words 'TO' of the code should be in column 40.
All the reserved words 'DIVISION' of the code should be in column 40 also.

And so on...
The use of 'TO' is like this:

MOVE WRK-VAR TO WRK-DISPLAY-VAR.

But, there is possible that the programmer use the 'TO' to declare a variable
like:

WRK-VAR-TO or TO-VAR

Those MUST NOT be aligned.

And the DIVISION can have a . (dot) after it OR not.
Like this:

'PROCEDURE DIVISION.'
'PROCEDURE DIVISION USING CP-VAR'.

In both occasions the 'DIVISION' MUST be in column 40.

And, This is what i have done, and they are working perfectly thanks to you
guys:

^!Find "(\R| )(TO)(\R| )" TISR2

^!Find "(\R| )(DIVISION)(\R| |\.)" TISR2


Now, \R represents line break right?

For 'TO' Find it should also be used because there can be cases like this:

' MOVE WRK-VAR-VERY-VERY-VERY-BIG
TO WRK-VAR-DISPLAY'

This should be like this:

' MOVE WRK-VAR-VERY-VERY-VERY-BIG
                                   TO WRK-VAR-DISPLAY'

But that wont happen in DIVISION, it should never be on the start of a line.

Anyways, I made the whole code already to move the words to the right column, my
doubt was only about the ^!Find command really.

Thanks,
Lucas.

--- In ntb-clips@yahoogroups.com, "flo.gehrke" <flo.gehrke@...> wrote:
>
> --- In ntb-clips@yahoogroups.com, "Lucas" <lucas.jfelix@> wrote:
> >
> > Hello again,
> >
> > Exactly John!
> >
> > The cenario i got here is...
>
>
> Hi Lucas,
>
> I would like to understand why you try to ...
>
> > select the 'TO' but only when it is arround spaces and only
> > the word 'TO', it shouldnt select the spaces aswell.
>
> Assuming that you browse a document and search that pattern, I wonder what
makes the difference between selecting the 'TO' but not the enclosing spaces?
Anyway, it's a match, isn't it?
>
> What's next after matching the 'TO'? What's the use of this proceeding?
>
> Probably, we could find another appropriate solution if you could shed some
light on this question. Thanks...
>
> Flo
>

--- In ntb-clips@yahoogroups.com, "Lucas" <lucas.jfelix@...> wrote:
>
> Hi Flo,
>
> Thanks for the explanation about \b, now i get it.
>
> About what am i doing really:
>
> I'm working on a project here to indent/organize my COBOL
> source code....

Lucas,

Obviously, it's less complicated to deal with 'DIVISION'. So let's have another
look at 'TO'.

The clip...

^!Find "(\R| )(TO)(\R| )" TISR2

seems to be OK for you. Nevertheless, you may consider the following clip (to
make spaces more visible they are written in Hex \x20)...

^!Find "(\n|\x20)(TO)\x20" SR2

According with your explanations, the '\R' in the third parentheses seems to be
inconsistent since you are searching a 'TO' that is enclosed in spaces. So it
will never be followed immediately by a CRNL. Certainly, you could omit that
'\R'. You could even omit the third parentheses at all since, with the '2'
option, you select the second substring only.

I wonder why you choose the 'I' option. If 'TO' is always written in upper case
letters you shouldn't ignore the case.

The 'T' option is unnecessary here because you don't want to find 'TO' within
longer words but as a whole word only. Also, it makes no sense to combine RegEx
and 'T' because a RegEx doesn't match whole words only anyway unless you define
word borders.

Note that the RegEx wouldn't match a 'TO' at the start of the subject string
because that position is not preceded by a CRNL or NL.

So far, we've discussed how to find 'TO'. However, I still can't see how you
indent the 'TO' to column 40 once you've found it. Are you doing this manually?
Maybe a perfect clip could automate this with something like...

^!Jump Doc_Start
:Search
^!Find "(\n|\x20)(TO)\x20" RS2
^!IfError End
;  Next one long line
^!Replace "^$GetSelection$" >> "^$StrFill(^%Space%;40)$^$GetSelection$" HS
^!Goto Search

Regards,
Flo

Having been silly enough to volunteer, I shall probably have to deal
with some UTF-8 pages in the near future. As they are apt to contain
German umlauts, French accents and Cyrillic letters, possibly some Greek
too, NoteTab's UTF mode won't be any use to me, as it would always
destroy the pages. This is not too bad, I'll mostly deal with HTML tags,
not existing content, so opening as "UTF-8 no conversion" will do me
fine.

I may do some editing too and then I shall need two things. The first is
probably simple. I will need to convert typed umlauts to UTF. This could
be "Ä"
^!Find "Ä(?![€-¿]" RASTI
When not followed by any of those, it can't be part of a valid
UTF-sequence. The same for "ä"
^!Find "ä(?![€-¿]{2}" RASTI
So I can easily make replaces for the typical accents and umlauts.

My second problem is harder. I will want to test for illegal characters.
Legal UTF-8 can be defined as
^!Find "([\x01-\x7F]|[À-ß][€-¿]|[à-ÿ][€-¿]{2}" RASTI
So illegal UTF-8 is the negative of that. Apart from reading characters
one by one and processing thorough loads of ^!If's, is there an easy way
to ^!Find an illegal character?

Danke
	 Axel

On 2011-07-24 17:59, Axel Berger wrote:
> My second problem is harder. I will want to test for illegal characters.
> Legal UTF-8 can be defined as
> ^!Find "([\x01-\x7F]|[À-ß][€-¿]|[à-ÿ][€-¿]{2}" RASTI
> So illegal UTF-8 is the negative of that. Apart from reading characters
> one by one and processing thorough loads of ^!If's, is there an easy way
> to ^!Find an illegal character?
I'm not sure what you need to do with a specific illegal once found?

Assuming non-legal characters are somewhat rare (?) could you:
(1) make a copy of the full text
(2) change your ^!Find above to a ^!Replace which converts ALL legal
UTF-8 characters to the same character.
(3) ^!Find every character not matching (hence and illegal character) in
a loop
(4) Calculate position of each and do what ever required to the matching
character at same position in original buffer

I've got a hunch (but haven't found the appropriate $Str....$ functions
that having done (2) above you might be able to get results by changing
either original and converted buffers to string(s?) and doing string
functions on them ....

Regards ... Alec   (buralex@gmail&  WinLiveMess - alec.m.burgess@skype)

You can include most of the legal characters within ranges within a negative
class. Others can be added individually.
Then, you can run a clip to locate any character that is not included in the
negative classes.

May I suggest BabelMap, the best character map I have found. Quite easy to
determine the ranges by inspection.

Regards,
John

From: ntb-clips@yahoogroups.com [mailto:ntb-clips@yahoogroups.com] On Behalf Of
Axel Berger
Sent: Sunday, July 24, 2011 14:59
To: NoteTab Clips
Subject: [Clip] Dealing with UTF


Having been silly enough to volunteer, I shall probably have to deal
with some UTF-8 pages in the near future. As they are apt to contain
German umlauts, French accents and Cyrillic letters, possibly some Greek
too, NoteTab's UTF mode won't be any use to me, as it would always
destroy the pages. This is not too bad, I'll mostly deal with HTML tags,
not existing content, so opening as "UTF-8 no conversion" will do me
fine.

I may do some editing too and then I shall need two things. The first is
probably simple. I will need to convert typed umlauts to UTF. This could
be "Ä"
^!Find "Ä(?![€-¿]" RASTI
When not followed by any of those, it can't be part of a valid
UTF-sequence. The same for "ä"
^!Find "ä(?![€-¿]{2}" RASTI
So I can easily make replaces for the typical accents and umlauts.

My second problem is harder. I will want to test for illegal characters.
Legal UTF-8 can be defined as
^!Find "([\x01-\x7F]|[À-ß][€-¿]|[à-ÿ][€-¿]{2}" RASTI
So illegal UTF-8 is the negative of that. Apart from reading characters
one by one and processing thorough loads of ^!If's, is there an easy way
to ^!Find an illegal character?

Danke
Axel



[Non-text portions of this message have been removed]

--- In ntb-clips@yahoogroups.com, Axel Berger <Axel-Berger@...> wrote:
>
> My second problem is harder. I will want to test for illegal
> characters. Legal UTF-8 can be defined as
> ^!Find "([\x01-\x7F]|[À-ß][?-¿]|[à-ÿ][?-¿]{2}" RASTI
> So illegal UTF-8 is the negative of that. Apart from
> reading characters one by one and processing thorough
> loads of ^!If's, is there an easy way to ^!Find an
> illegal character?

Axel,

To be frank, I'm not much familar with encoding. But I found an "UTF-8-ness
checker using a regular expression" at...

http://www.php.net/manual/de/function.mb-detect-encoding.php#50087

It's written for PHP. So I took that RegEx and transcribed it to the PCRE used
with NoteTab. To make it more readable, I inserted some spaces (using the '(?x)'
modifier) and took over the comments from that PHP version. Since it finds legal
UTF-8, I turned it into a negation by using a Negative Lookahead. It says: Find
any character at a position where you DO NOT see a legal UTF-8 when looking
ahead. So this '^!Find' could possibly match any illegal UTF-8:

^!Find "(?x) (?!(?:(?#ASCII)[\x09\x0A\x0D\x20-\x7E] | (?#non-overlong
2-byte)[\xC2-\xDF][\x80-\xBF] | (?#excluding
overlongs)\xE0[\xA0-\xBF][\x80-\xBF] | (?#straight
3-byte)[\xE1-\xEC\xEE\xEF][\x80-\xBF]{2} | (?#excluding
surrogates)\xED[\x80-\x9F][\x80-\xBF] | (?#planes
1-3)\xF0[\x90-\xBF][\x80-\xBF]{2} | (?#planes 4-15)[\xF1-\xF3][\x80-\xBF]{3} |
(?#plane 16)\xF4[\x80-\x8F][\x80-\xBF]{2}))." RS


Regards,
Flo

--- In ntb-clips@yahoogroups.com, "Eb" <ebbtidalflats@...> wrote:
>
> Lucas,
>
> Below is a comment on your matching "to.", and a suggestion for some tests you
might want to make.
> (...)
> The Plain search (non-regexp) does not find words adjacent
> to $ or #. This is either an esoteric feature, or a bug.
> (...)
> Plain text search for WHOLE words misses the following (Feature?
> or Bug?)...

Eb,

Thanks for this documentation! It's extremely important to note these problems.

I can't see any rule behind this either. My vague impression is that the experts
still cannot agree on defining word characters. For example...

> Both plain text and \bto\b miss the following: _to "_to "

'_' is matched with '\w', i.e. it's interpreted as a word character. So there is
no word border between '_' and 'to', and, consequently, '\bto\b' doesn't match.

Below you will find two "Test Whole Words" clips which might help to check
conditions like that when creating clips.

The first clip produces a table with test data like...

045 -word
046 .word
047 /word

It starts with the decimal values from ANSI 32 to 255 followed by a string that
combines the ANSI character with 'word'.

Having produced the table, run the second clip on that table. It prompts you to
edit the search term 'word'. For example, add word borders '\bword\b' or use
RegEx like '[[:punct:]]word'. But always choose a pattern that matches 'word' in
any way! Next, edit the search options (R,I,C,T, etc).

After OK, the clip will display what has been matched with your criteria and
what has not been matched. For example, it confirms Eb's result that a plain
(non-RegEx) search (options CS whole words only) will miss '#word' or '$word'
but will match '%word' or '&word'.

Regards,
Flo


First clip

;  Create a table from ANSI 32 to 255
^!Set %Dec%=31
:Start
^!Inc %Dec%
^!If ^%Dec% > 255 End
^!If ^%Dec% <= 99 Next Else Skip
^!Set %Dec%=0^%Dec%
^!InsertText ^%Dec%^%Space%^$DecToChar(^%Dec%)$word^%NL%
^!Goto Start

Second clip (to be run on the ANSI table)

;  Paste complete ANSI-table to clipboard
^!SetClipboard ^$GetText$
^!Jump Doc_Start
^!SetWizardWidth=70
^!SetWizardLabel Enter Search Criteria
^!Set %SearchStr%=^?{Edit Search String (in quotes):="word"};
%Options%=^?{Choose Options=RTCIS}
^!IfRegexOk "^%SearchStr%" Next Else Message

:Search
^!Find "^%SearchStr%" ^%Options%
^!IfError Out
^!Set %Match%=^$GetLine$
^!Append %True%=^%Match%^%NL%
^!If ^$GetRow$=^$GetTextLineCount$ Out
^!Jump Select_End
^!Goto Search

:Out
^!Toolbar New Document
^!InsertText ^%True%
^!Jump Doc_End
;  Insert complete ANSI table
^!Paste
^!Select All
^$StrSort("^$GetSelection$";0;1;0)$
;  Subtract ANSI list minus list %True% (=Not found)
^!Replace "(^[^\r\n]+)\r\n(\1)(\R|\Z)" >> "" WARS
;  Output and format result
^!Jump Doc_Start
^!InsertText Not found^P^$StrFill(-;9)$^P
^!Jump Doc_End
^!InsertText ^P^PWords found^P^$StrFill(-;11)$^P^%True%
^!ClearVariable %True%
^!Goto End

:Message
^!Info Error in RegEx

Thanks Alec, John and Flo,

"flo.gehrke" wrote:
> It says: Find any character at a position where you DO NOT
> see a legal UTF-8 when looking ahead. So this '^!Find' could
> possibly match any illegal UTF-8:

That's an interesting idea and your sample is more precise than my crude
solution, though I have yet to understand some of the differences. But:
I have some character follwed by a legal sequence. I next find the first
by of that sequence followed by the truncated rest, which is not a legal
sequence and get a false positive.

John, the problem is a character may be illegal on its own but legal in
a specific position of a two or three character UTF-sequence. My two
examples for Ä demostrate this.

Alec, illegal characters should be rare or nonexistant if I make no
mistakes. I end several of my conversion clips with a find that
highlights all possible problem cases for manual inspection. So this
search must not destroy anything and must enable me to make manual
corrections where needed. I need not be very precise, I typically
inspect five to ten places for one needed correction.

Axel

"flo.gehrke" wrote:
> ^!Find "(?x) (?!(?:(?#ASCII)[\x09\x0A\x0D\x20-\x7E] | (?#non-overlong
2-byte)[\xC2-\xDF][\x80-\xBF] | (?#excluding
overlongs)\xE0[\xA0-\xBF][\x80-\xBF] | (?#straight
3-byte)[\xE1-\xEC\xEE\xEF][\x80-\xBF]{2} | (?#excluding
surrogates)\xED[\x80-\x9F][\x80-\xBF] | (?#planes
1-3)\xF0[\x90-\xBF][\x80-\xBF]{2} | (?#planes 4-15)[\xF1-\xF3][\x80-\xBF]{3} |
(?#plane 16)\xF4[\x80-\x8F][\x80-\xBF]{2}))." RS

Flo,

two questions:
Your sequence seems to be "(?!<a lot>)." Shouldn't the dot come first
".(?!<a lot>)"?
And should not DOTALL be asserted first?
It seems I also need to invoke UTF mode by (*UTF8).

Do you agree?

Danke
	 Axel

--- In ntb-clips@yahoogroups.com, Axel Berger <Axel-Berger@...> wrote:
>
> Flo, two questions:...

Axel,

> Your sequence seems to be "(?!<a lot>)." Shouldn't the dot come
> first ".(?!<a lot>)"?

No! You can test that concept as follows:

'(?!A).' will match any upper case letter that is no 'A' (case-sensitive
search). Whereas '.(?!A)' will match any character (including 'A' itself) that
is not followed by an 'A'.

The logic behind this: The Negative Lookahead is an assertion, i.e. it doesn't
consume any character. Thus the '.' and the 'no-A' are matching the same
position.

> And should not DOTALL be asserted first?

DOTALL means that also a NL will be matched. I'm not quite sure if this is
necessary. Sorry, I have to leave that question to encoding experts. This also
pertains to...

> It seems I also need to invoke UTF mode by (*UTF8).

Maybe a test will show?

Regards,
Flo

--- In ntb-clips@yahoogroups.com, "flo.gehrke" <flo.gehrke@...> wrote:
>
> '(?!A).' will match any upper case letter that is no 'A' (case-sensitive
search)...

Upss, sorry, That was to fast ;-)

It matches ANY character that is no upper-case 'A' (case-sensitive search)
including lower-case 'a' of course.

Flo

"flo.gehrke" wrote:
> The logic behind this: The Negative Lookahead is an
> assertion, i.e. it doesn't consume any character. Thus the
> '.' and the 'no-A' are matching the same position.

Got it, thanks.

> > It seems I also need to invoke UTF mode by (*UTF8).
> Maybe a test will show?

It did. I can't get it to work. Asserting UTF mode the whole sequence is
seen as one byte, thus it never matches any of the multi-byte sequences.
Not asserting UTF will check the first byte of a sequence, the truncated
rest of which is illegal.

Either way the search stops at every UTF occurrance. Seems it'll have to
be the loop after all, or no test before the upload and use an external
validator.

Danke
	 Axel

Axel Berger wrote:
> Seems it'll have to be the loop after all,

The following may not be the best solution, but it's the only one I
could get to work reliably:

:loop
^!Find "([\x80-\xBF]|[\xC0-\xFF][\x80-\xBF]*)" RS
^!IfError usasc
^!IfMatch "[\xC2-\xDF][\x80-\xBF]" "^$GetSelection$" loop
^!IfMatch "\xE0[\xA0-\xBF][\x80-\xBF]" "^$GetSelection$" loop
^!IfMatch "[\xE1-\xEC\xEE\xEF][\x80-\xBF]{2}" "^$GetSelection$" loop
^!IfMatch "\xED[\x80-\x9F][\x80-\xBF]" "^$GetSelection$" loop
^!IfMatch "\xF0[\x90-\xBF][\x80-\xBF]{2}" "^$GetSelection$" loop
^!IfMatch "[\xF1-\xF3][\x80-\xBF]{3}" "^$GetSelection$" loop
^!IfMatch "\xF4[\x80-\x8F][\x80-\xBF]{2}" "^$GetSelection$" loop
^!Continue no match
^!Goto loop
:usasc
^!Continue No errors found

With no errors being the normal case and illegal characters hopefully
rare I can live with sometimes having to start the clip several times.

Thanks for all the help.

Axel

Hello friends,

I have looked through the clip archives and have also (tried to) read
Jody's manual, but I can't figure out how to make the suggestions I
found there work. Can you give me a hand?

I want to remove -entirely- any line that begins with a certain tag,
no matter how long the string of characters that follow.

for instance, I want this whole line to just go away, no matter where
it appears in the file, no matter how long the code is. It will always
begin 1 _UID

1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA

here's one of the (scores of) variations I tried - saved as a clip,
highlighted the whole file and pulled the trigger. Nada:

^!Replace "1 _UID .*\$" >> "" rwais

thanks for your help.
Jane

The problem is with \$ which says you are looking for a $ in the file. Remove
the slash and it will work. However, as
written, it will leave blank lines for each of them. To prevent the blank lines,
use \R instead of $.

Regards,
John

From: ntb-clips@yahoogroups.com [mailto:ntb-clips@yahoogroups.com] On Behalf Of
Jane Peppler
Sent: Monday, July 25, 2011 18:05
To: ntb-Clips@yahoogroups.com
Subject: [Clip] Delete lines of varying length that begin with a certain tag.
Help?


Hello friends,

I have looked through the clip archives and have also (tried to) read
Jody's manual, but I can't figure out how to make the suggestions I
found there work. Can you give me a hand?

I want to remove -entirely- any line that begins with a certain tag,
no matter how long the string of characters that follow.

for instance, I want this whole line to just go away, no matter where
it appears in the file, no matter how long the code is. It will always
begin 1 _UID

1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA

here's one of the (scores of) variations I tried - saved as a clip,
highlighted the whole file and pulled the trigger. Nada:

^!Replace "1 _UID .*\$" >> "" rwais

thanks for your help.
Jane



[Non-text portions of this message have been removed]

Just \R won't work if "1 _UID" appears on last line in file ... so ...
(not tested ;-) )
^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
where \Z represents end-of-file or buffer

On 2011-07-25 21:52, John Shotsky wrote:
> The problem is with \$ which says you are looking for a $ in the file. Remove
the slash and it will work. However, as
> written, it will leave blank lines for each of them. To prevent the blank
lines, use \R instead of $.
>
> Regards,
> John
>
> From:ntb-clips@yahoogroups.com  [mailto:ntb-clips@yahoogroups.com] On Behalf
Of Jane Peppler
> Sent: Monday, July 25, 2011 18:05
> To:ntb-Clips@yahoogroups.com
> Subject: [Clip] Delete lines of varying length that begin with a certain tag.
Help?
<snip>
> 1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
>
> here's one of the (scores of) variations I tried - saved as a clip,
> highlighted the whole file and pulled the trigger. Nada:
>
> ^!Replace "1 _UID .*\$">>  "" rwais


--
Regards ... Alec (buralex@gmail & WinLiveMess - alec.m.burgess@skype)

Jane,

John beat me to it (to make it work), but I would add a couple of teaks to
the search string make it more reliable, namely:

                        ^1 _UID .*?\R

The leading "^" forces the pattern match to start in column 1 instead of
anywhere in the line (although I think Flo said it doesn't work in NTB Pro).

The "?" makes the ".*" non-greedy. RegEx is supposed to stop at the line
terminator but "just in case...". IMHO, adding a quantifier is a good habit
to develop.

Also, you can speed up your coding by developing your search pattern using
the Menu/Toolbar Find command. Start simple and keep adding to the pattern
until you're satisfied, then just copy it to the Replace command.

Namaste',  Art

At 07/25/2011 18:05, you wrote:
>Hello friends,
>
>I have looked through the clip archives and have also (tried to) read
>Jody's manual, but I can't figure out how to make the suggestions I
>found there work. Can you give me a hand?
>
>I want to remove -entirely- any line that begins with a certain tag,
>no matter how long the string of characters that follow.
>
>for instance, I want this whole line to just go away, no matter where
>it appears in the file, no matter how long the code is. It will always
>begin 1 _UID
>
>1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
>
>here's one of the (scores of) variations I tried - saved as a clip,
>highlighted the whole file and pulled the trigger. Nada:
>
>^!Replace "1 _UID .*\$" >> "" rwais
>
>thanks for your help.
>Jane

^ is alive and well in pro to signify a line start.

> The leading "^" forces the pattern match to start in column 1 instead of
> anywhere in the line (although I think Flo said it doesn't work in NTB Pro).

Yes, you're right. Years ago, I began my clip libraries with two clips that
assure me that I don't need to remember
about these issues.

One is that I replace \R with \r\n. That assures that there is only one kind of
line end in my files.

The other is that I replace \z with \r\n. That assures me that I have a blank
line on the end of my file.

Knowing these are non-issues up front, I have no need to make provisions for
them elsewhere in the clip library. But I
agree, for a random clip, such precautions are wise.

Also I agree with Art that ^ should be used with the beginning of the find line.
Otherwise, it could find 11_UID. ^
works just fine in Pro – I use that and\or $ in most of my clips and my users
use all three versions of NoteTab
successfully with my clips.

Regards,
John

From: ntb-clips@yahoogroups.com [mailto:ntb-clips@yahoogroups.com] On Behalf Of
Alec Burgess
Sent: Monday, July 25, 2011 19:06
To: ntb-clips@yahoogroups.com
Subject: Re: [Clip] Delete lines of varying length that begin with a certain
tag. Help?


Just \R won't work if "1 _UID" appears on last line in file ... so ...
(not tested ;-) )
^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
where \Z represents end-of-file or buffer

On 2011-07-25 21:52, John Shotsky wrote:
> The problem is with \$ which says you are looking for a $ in the file. Remove
the slash and it will work. However, as
> written, it will leave blank lines for each of them. To prevent the blank
lines, use \R instead of $.
>
> Regards,
> John
>
> From:ntb-clips@yahoogroups.com <mailto:ntb-clips%40yahoogroups.com> 
[mailto:ntb-clips@yahoogroups.com
<mailto:ntb-clips%40yahoogroups.com> ] On Behalf Of Jane Peppler
> Sent: Monday, July 25, 2011 18:05
> To:ntb-Clips@yahoogroups.com <mailto:ntb-Clips%40yahoogroups.com>
> Subject: [Clip] Delete lines of varying length that begin with a certain tag.
Help?
<snip>
> 1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
>
> here's one of the (scores of) variations I tried - saved as a clip,
> highlighted the whole file and pulled the trigger. Nada:
>
> ^!Replace "1 _UID .*\$">> "" rwais

--
Regards ... Alec (buralex@gmail & WinLiveMess - alec.m.burgess@skype)



[Non-text portions of this message have been removed]

Eeks, no it didn't work!? This is what my clip looks like now, John:

^!Replace "1 _UID .*\R" >> "" rwais

Fail.

What am I doing wrong?
Ja e

On 25 July 2011 21:52, John Shotsky <jshotsky@...> wrote:
> The problem is with \$ which says you are looking for a $ in the file. Remove
the slash and it will work. However, as
> written, it will leave blank lines for each of them. To prevent the blank
lines, use \R instead of $.
>
> Regards,
> John
>
> From: ntb-clips@yahoogroups.com [mailto:ntb-clips@yahoogroups.com] On Behalf
Of Jane Peppler
> Sent: Monday, July 25, 2011 18:05
> To: ntb-Clips@yahoogroups.com
> Subject: [Clip] Delete lines of varying length that begin with a certain tag.
Help?
>
>
> Hello friends,
>
> I have looked through the clip archives and have also (tried to) read
> Jody's manual, but I can't figure out how to make the suggestions I
> found there work. Can you give me a hand?
>
> I want to remove -entirely- any line that begins with a certain tag,
> no matter how long the string of characters that follow.
>
> for instance, I want this whole line to just go away, no matter where
> it appears in the file, no matter how long the code is. It will always
> begin 1 _UID
>
> 1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
>
> here's one of the (scores of) variations I tried - saved as a clip,
> highlighted the whole file and pulled the trigger. Nada:
>
> ^!Replace "1 _UID .*\$" >> "" rwais
>
> thanks for your help.
> Jane
>
>
>
> [Non-text portions of this message have been removed]
>
>
>
> ------------------------------------
>
> Fookes Software: http://www.fookes.com/
> NoteTab website: http://www.notetab.com/
> NoteTab Discussion Lists: http://www.notetab.com/groups.php
>
> ***
> Yahoo! Groups Links
>
>
>
>

Argh, no, that did not work either! Thanks for trying though, both of you.
Any other ideas? Jane

On 25 July 2011 22:05, Alec Burgess <buralex@...> wrote:

> **
>
>
> Just \R won't work if "1 _UID" appears on last line in file ... so ...
> (not tested ;-) )
> ^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
> where \Z represents end-of-file or buffer
>
>
> On 2011-07-25 21:52, John Shotsky wrote:
> > The problem is with \$ which says you are looking for a $ in the file.
> Remove the slash and it will work. However, as
> > written, it will leave blank lines for each of them. To prevent the blank
> lines, use \R instead of $.
> >
> > Regards,
> > John
> >
> > From:ntb-clips@yahoogroups.com [mailto:ntb-clips@yahoogroups.com] On
> Behalf Of Jane Peppler
> > Sent: Monday, July 25, 2011 18:05
> > To:ntb-Clips@yahoogroups.com
> > Subject: [Clip] Delete lines of varying length that begin with a certain
> tag. Help?
> <snip>
>
> > 1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
> >
> > here's one of the (scores of) variations I tried - saved as a clip,
> > highlighted the whole file and pulled the trigger. Nada:
> >
> > ^!Replace "1 _UID .*\$">> "" rwais
>
> --
> Regards ... Alec (buralex@gmail & WinLiveMess - alec.m.burgess@skype)
>
>
>


[Non-text portions of this message have been removed]

It worked! Thank you all! Now, one more question - since I see some of
these corrupted entries start with different numbers (ie 2 _UID or 3
_UID) what is the proper wild card syntax? You are great to help me.
Gratefully,
Jane

On 25 July 2011 22:41, John Shotsky <jshotsky@...> wrote:
> Yes, you're right. Years ago, I began my clip libraries with two clips that
assure me that I don't need to remember
> about these issues.
>
> One is that I replace \R with \r\n. That assures that there is only one kind
of line end in my files.
>
> The other is that I replace \z with \r\n. That assures me that I have a blank
line on the end of my file.
>
> Knowing these are non-issues up front, I have no need to make provisions for
them elsewhere in the clip library. But I
> agree, for a random clip, such precautions are wise.
>
> Also I agree with Art that ^ should be used with the beginning of the find
line. Otherwise, it could find 11_UID. ^
> works just fine in Pro – I use that and\or $ in most of my clips and my users
use all three versions of NoteTab
> successfully with my clips.
>
> Regards,
> John
>
> From: ntb-clips@yahoogroups.com [mailto:ntb-clips@yahoogroups.com] On Behalf
Of Alec Burgess
> Sent: Monday, July 25, 2011 19:06
> To: ntb-clips@yahoogroups.com
> Subject: Re: [Clip] Delete lines of varying length that begin with a certain
tag. Help?
>
>
> Just \R won't work if "1 _UID" appears on last line in file ... so ...
> (not tested ;-) )
> ^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
> where \Z represents end-of-file or buffer
>
> On 2011-07-25 21:52, John Shotsky wrote:
>> The problem is with \$ which says you are looking for a $ in the file. Remove
the slash and it will work. However, as
>> written, it will leave blank lines for each of them. To prevent the blank
lines, use \R instead of $.
>>
>> Regards,
>> John
>>
>> From:ntb-clips@yahoogroups.com <mailto:ntb-clips%40yahoogroups.com>
 [mailto:ntb-clips@yahoogroups.com
> <mailto:ntb-clips%40yahoogroups.com> ] On Behalf Of Jane Peppler
>> Sent: Monday, July 25, 2011 18:05
>> To:ntb-Clips@yahoogroups.com <mailto:ntb-Clips%40yahoogroups.com>
>> Subject: [Clip] Delete lines of varying length that begin with a certain tag.
Help?
> <snip>
>> 1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
>>
>> here's one of the (scores of) variations I tried - saved as a clip,
>> highlighted the whole file and pulled the trigger. Nada:
>>
>> ^!Replace "1 _UID .*\$">> "" rwais
>
> --
> Regards ... Alec (buralex@gmail & WinLiveMess - alec.m.burgess@skype)
>
>
>
> [Non-text portions of this message have been removed]
>
>
>
> ------------------------------------
>
> Fookes Software: http://www.fookes.com/
> NoteTab website: http://www.notetab.com/
> NoteTab Discussion Lists: http://www.notetab.com/groups.php
>
> ***
> Yahoo! Groups Links
>
>
>
>

On 2011-07-25 22:08, Jane Peppler wrote:
> Argh, no, that did not work either! Thanks for trying though, both of you.
> Any other ideas? Jane
Then you said ...
> It worked! Thank you all! Now, one more question - since I see some of
> these corrupted entries start with different numbers (ie 2 _UID or 3
> _UID) what is the proper wild card syntax? You are great to help me.
Jane: Based on time stamps of messages I'm not sure which is last ...
Assuming that what worked was this (or some variant of it):
^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
then all you do is change initial "1" to "\d" (w/o quotes - means any
single digit) .... hence:
^!Replace "^\d _UID .*(?:\$\Z)" >> "" rwais
(where I've added the leading ^ (means match only at beginning of line)
suggested by others.

I know that regular expression syntax can seem intimidating at first.
All of the [Help on Regular Expressions] (3rd entry down on Notetab-Help
is worth reading but I'd suggest first skimming first entry [Notetab and
PCRE] followed by 2nd last entry [PCRE Syntax Summary].

Bear in mind that some of the "stuff" described applies to programmers
who have direct access to PCRE internals (eg. Callouts and references to
PCRE functions such as pcre_dfa_exec() )

Hope this helps ... soon you will be providing help to others in this
group 8-)

Regards ... Alec   (buralex@gmail&  WinLiveMess - alec.m.burgess@skype)


> On 25 July 2011 22:05, Alec Burgess <buralex@...
> <mailto:buralex%40gmail.com>> wrote:
>
> > **
> >
> >
> > Just \R won't work if "1 _UID" appears on last line in file ... so ...
> > (not tested ;-) )
> > ^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
> > where \Z represents end-of-file or buffer
> >
> >
> > On 2011-07-25 21:52, John Shotsky wrote:
> > > The problem is with \$ which says you are looking for a $ in the file.
> > Remove the slash and it will work. However, as
> > > written, it will leave blank lines for each of them. To prevent
> the blank
> > lines, use \R instead of $.
> > >
> > > Regards,
> > > John
> > >
> > > From:ntb-clips@yahoogroups.com
> <mailto:ntb-clips%40yahoogroups.com> [mailto:ntb-clips@yahoogroups.com
> <mailto:ntb-clips%40yahoogroups.com>] On
> > Behalf Of Jane Peppler
> > > Sent: Monday, July 25, 2011 18:05
> > > To:ntb-Clips@yahoogroups.com <mailto:ntb-Clips%40yahoogroups.com>
> > > Subject: [Clip] Delete lines of varying length that begin with a
> certain
> > tag. Help?
> > <snip>
> >
> > > 1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
> > >
> > > here's one of the (scores of) variations I tried - saved as a clip,
> > > highlighted the whole file and pulled the trigger. Nada:
> > >
> > > ^!Replace "1 _UID .*\$">> "" rwais
> >
> > --
> > Regards ... Alec (buralex@gmail & WinLiveMess - alec.m.burgess@skype)
> >
> >
> >


[Non-text portions of this message have been removed]

Jane - OOPS! - I had typos in my first post and repeated them in my last;
Following *IS* tested and (unless Yahoo garbles it) should work:
^!Replace "^\d _UID .*(?:\R|\Z)" >> "" rwais

On Tue, 26 Jul 2011 02:10:48 -0400  Alec Burgess
<buralex@...> said (in part):
> On 2011-07-25 22:08, Jane Peppler wrote:
>> Argh, no, that did not work either! Thanks for trying though, both of
>> you.
>> Any other ideas? Jane
> Then you said ...
>> It worked! Thank you all! Now, one more question - since I see some of
>> these corrupted entries start with different numbers (ie 2 _UID or 3
>> _UID) what is the proper wild card syntax? You are great to help me.
> Jane: Based on time stamps of messages I'm not sure which is last ...
> Assuming that what worked was this (or some variant of it):
> ^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
> then all you do is change initial "1" to "\d" (w/o quotes - means any
> single digit) .... hence:
> ^!Replace "^\d _UID .*(?:\$\Z)" >> "" rwais
> (where I've added the leading ^ (means match only at beginning of
> line) suggested by others.
>
> I know that regular expression syntax can seem intimidating at first.
> All of the [Help on Regular Expressions] (3rd entry down on
> Notetab-Help is worth reading but I'd suggest first skimming first
> entry [Notetab and PCRE] followed by 2nd last entry [PCRE Syntax Summary].
>
> Bear in mind that some of the "stuff" described applies to programmers
> who have direct access to PCRE internals (eg. Callouts and references
> to PCRE functions such as pcre_dfa_exec() )
>
> Hope this helps ... soon you will be providing help to others in this
> group 8-)
> Regards ... Alec   (buralex@gmail&  WinLiveMess - alec.m.burgess@skype)
>
>> On 25 July 2011 22:05, Alec Burgess <buralex@...
>> <mailto:buralex%40gmail.com>> wrote:
>>
>> > **
>> >
>> >
>> > Just \R won't work if "1 _UID" appears on last line in file ... so ...
>> > (not tested ;-) )
>> > ^!Replace "1 _UID .*(?:\$\Z)" >> "" rwais
>> > where \Z represents end-of-file or buffer
>> >
>> >
>> > On 2011-07-25 21:52, John Shotsky wrote:
>> > > The problem is with \$ which says you are looking for a $ in the
>> file.
>> > Remove the slash and it will work. However, as
>> > > written, it will leave blank lines for each of them. To prevent
>> the blank
>> > lines, use \R instead of $.
>> > >
>> > > Regards,
>> > > John
>> > >
>> > > From:ntb-clips@yahoogroups.com
>> <mailto:ntb-clips%40yahoogroups.com>
>> [mailto:ntb-clips@yahoogroups.com
>> <mailto:ntb-clips%40yahoogroups.com>] On
>> > Behalf Of Jane Peppler
>> > > Sent: Monday, July 25, 2011 18:05
>> > > To:ntb-Clips@yahoogroups.com <mailto:ntb-Clips%40yahoogroups.com>
>> > > Subject: [Clip] Delete lines of varying length that begin with a
>> certain
>> > tag. Help?
>> > <snip>
>> >
>> > > 1 _UID 6E58E0BD-56B3-4861-9310-EDB94FC9B9AA
>> > >
>> > > here's one of the (scores of) variations I tried - saved as a clip,
>> > > highlighted the whole file and pulled the trigger. Nada:
>> > >
>> > > ^!Replace "1 _UID .*\$">> "" rwais
>> >
>> > --
>> > Regards ... Alec (buralex@gmail & WinLiveMess - alec.m.burgess@skype)
>> >
>> >
>> >


[Non-text portions of this message have been removed]

--- In ntb-clips@yahoogroups.com, Art Kocsis <artkns@...> wrote:
>
> The leading "^" forces the pattern match to start in column 1
> instead of anywhere in the line (although I think Flo said it
> doesn't work in NTB Pro).

Art,

No, I wouldn't say that. I suspect that's a misunderstanding that goes back to
topic #21534 of 02/17/2011. The issue, in that case, was not '^' but the '{0,}'
or '*' quantifier causing problems at the beginning of a line.

Nevertheless, we see different issues with '^' but they do not pertain to the
context of the topic that is discussed here.

Regards,
Flo

Hey Guys,

I'm wondering here... is there a way i can match and replace all occurrences of
invalid characters in my text?

Like, i only want my text to have alphanumeric and some special characters
(*,'."()[]{}!@#$%¨&\/=+-|).

Guess its hard right, i want to remove characters like:
¥☺╣₧♀♣♂

Thanks.

replace with regex checked the following:
\&#\d{3,4};
with nothing

On 7/26/2011 8:42 PM, Lucas wrote:
> Hey Guys,
>
> I'm wondering here... is there a way i can match and replace all occurrences
of invalid characters in my text?
>
> Like, i only want my text to have alphanumeric and some special characters
(*,'."()[]{}!@#$%¨&\/=+-|).
>
> Guess its hard right, i want to remove characters like:
> ¥☺╣₧♀♣♂
>
> Thanks.

The pound sign needs to be escaped. PCRE uses them in comments, and results in
NoteTab are unreliable without the
escape. These problems are EXTREMELY difficult to troubleshoot.

A lot of such characters are Unicode versions of ASCII characters. In that case,
you would probably want to replace them
with the ascii equivalent. I have a whole clip library that parses these things,
and converts numerous versions of the
same character to the ascii equivalent. I don't think there's a one liner that
will give the results you really want.
One line:
^!Replace
"(&\#145;|&\#146;|'|&\#96;|′|&\#8242|‘|&\#8216|’|&\#8217|\
`|’|‘|´)" >> "\'" ARSW

These are all versions of single quotes or what might be found on the internet
as coded to be a single quote. Smart
quotes, etc, all become [']. Just deleting the high-order ones would probably
negatively affect the document under
revision.

Regards,
John

From: ntb-clips@yahoogroups.com [mailto:ntb-clips@yahoogroups.com] On Behalf Of
Don
Sent: Tuesday, July 26, 2011 17:52
To: ntb-clips@yahoogroups.com
Subject: Re: [Clip] Invalid Characters Verification


replace with regex checked the following:
\&#\d{3,4};
with nothing

On 7/26/2011 8:42 PM, Lucas wrote:
> Hey Guys,
>
> I'm wondering here... is there a way i can match and replace all occurrences
of invalid characters in my text?
>
> Like, i only want my text to have alphanumeric and some special characters
(*,'."()[]{}!@#$%¨&\/=+-|).
>
> Guess its hard right, i want to remove characters like:
> ¥☺╣₧♀♣♂
>
> Thanks.



[Non-text portions of this message have been removed]

Hi Flo,

I'll put your clips in my RegExp test suite.

Thanks,


Eb