KR-language : Messages : 671-712 of 712

Since there is a one-to-one correspondence between concepts
and their cyc:CycAnnotations_v1#label attributes,
I have modified mke to display output using the attribute
instead of the concept name.  The translation between concepts
and attributes uses a new GDBM table, cyclabel.

Here is an example of the new mke input and output.

rhm@rhm8200 /home/knowledge/opencyc
$ export KEDB=./db; export VIEW=latest
$ mke
ke$ do hofind od "AynRand"@en in cyclabel done;
Mx4rvr0Q45wpEbGdrcN5Y29ycA has cyc:CycAnnotations_v1#label "AynRand"@en;
ke$ Mx4rvr0Q45wpEbGdrcN5Y29ycA has ?;
"AynRand"@en has
/   rdfs:label "Ayn Rand"@en;
/   "wikipediaArticleURL"@en "http://en.wikipedia.org/wiki/Ayn_Rand";
/   "prettyString"@en "Rand"@en;
/   cyc:CycAnnotations_v1#label "AynRand"@en;
/   "wikipediaArticleName"@en "Ayn Rand";
ke$ exit;
$

Dick McCullough
http://mkrmke.org

#699

From: "Richard H. McCullough" <rhm@...>
Date: Wed Sep 23, 2009 2:38 pm
Subject: Re: comma in concept name

rhmcc

Offline

Sorry, false alarm.

My output procedure, hoprint, created a comma-separated list of concepts

that have the same rdfs:label.

Dick McCullough
http://mkrmke.org

----- Original Message -----

From: Richard H. McCullough

To: Cyclify Austin

Cc: KR-language

Sent: Wednesday, September 23, 2009 5:52 AM

Subject: comma in concept name

What is the meaning of a comma in a concept name?

example from opencyc/latest view

rhm@rhm8200 /home/knowledge/opencyc

$ mke
ke$ do homatch od ^rdfs:label "person"@en$ in hoattr done;
ke$ do homatch od ^rdfs:label \"person\"en$ in hoattr done;
ke$ do homatch od ^rdfs:label .person.@en$ in hoattr done;
Mx4rvViAkpwpEbGdrcN5Y29ycA,Mx8Ngh4r9er-nKUiQdiE-OdjE2nX7h4rIcwFloGUQdeMlsOWYLFB2w has rdfs:label "person"@en;
ke$ Mx4rvViAkpwpEbGdrcN5Y29ycA has ?;
Mx4rvViAkpwpEbGdrcN5Y29ycA has # rdfs:label "person"@en
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4r-dH_4JB7QdeAruTeHP-Itg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4r1QgvYN5dQdeMrOiqN8_42Q;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rDxIg_HSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rG2qp0nSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rGC-qsHSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rM0bV1HSyEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4r_F_SRnSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rj6yHfnStEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rpWduENpwQdeUs-K0ZLO2XQ;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rt02KDnSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv-0a8pwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv1SXhZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv4V2WZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvVjCBpwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvWgxLZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv_ZQbZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvbSq6pwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvqjUrpwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rwLpXZJwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rwPzQbJwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rwQCfP5wpEbGdrcN5Y29ycA;
/   Mx4rBVVEokNxEdaAAACgydogAg Mx4r2UyxsEJ2EduAAAACs0vk3Q;
/   Mx4riWVFR6HJSpaEaHrcWS3MSA "http://www.w3.org/2006/03/wn/wn20/instances/synset-person-noun-1";
/   Mx4rvcZ1FpwpEbGdrcN5Y29ycA Mx4rv-0a8pwpEbGdrcN5Y29ycA;
/   cyc:CycAnnotations_v1#label "Person"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "human"@en;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rKyCUeJCTQdeS1bGq39eSZw;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rbEfSDn8AEdaAAAABAjVgzA;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rsieVwHWaQdeAhsggL2dmvw;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rzfuG7n8AEdaAAAABAjVgzA;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "layman"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "laymen"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "mortal"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "people"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "mortals"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "persons"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "manpower"@en;
/   rdfs:label "person"@en;
/   Mx4rNv0nbm4TTjOp7yhmnzOyqg "http://en.wikipedia.org/wiki/Person";
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rAAnQ5r1TQdeNXYZ5j_YyOQ;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rG2qp0nSxEdaAAACgyZzFrg;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rGC-qsHSxEdaAAACgyZzFrg;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rt02KDnSxEdaAAACgyZzFrg;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rv-0a8pwpEbGdrcN5Y29ycA;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rvViWHZwpEbGdrcN5Y29ycA;
/   Mx4rTv-jk9SPTXa991kk5mAvHg "Person";
/   Mx4rvVj1MJwpEbGdrcN5Y29ycA Mx8Ngx4rvcUeB5wpEbGdrcN5Y29ycB4rbqdVPHTAEdaAAACgyZzFrh4rC5KBWupOQdiTk9hzkgQqVQ;
ke$ exit;

Dick McCullough
http://mkrmke.org

#698

From: "Richard H. McCullough" <rhm@...>
Date: Wed Sep 23, 2009 12:52 pm
Subject: comma in concept name

rhmcc

Offline

What is the meaning of a comma in a concept name?

example from opencyc/latest view

rhm@rhm8200 /home/knowledge/opencyc

$ mke
ke$ do homatch od ^rdfs:label "person"@en$ in hoattr done;
ke$ do homatch od ^rdfs:label \"person\"en$ in hoattr done;
ke$ do homatch od ^rdfs:label .person.@en$ in hoattr done;
Mx4rvViAkpwpEbGdrcN5Y29ycA,Mx8Ngh4r9er-nKUiQdiE-OdjE2nX7h4rIcwFloGUQdeMlsOWYLFB2w has rdfs:label "person"@en;
ke$ Mx4rvViAkpwpEbGdrcN5Y29ycA has ?;
Mx4rvViAkpwpEbGdrcN5Y29ycA has # rdfs:label "person"@en
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4r-dH_4JB7QdeAruTeHP-Itg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4r1QgvYN5dQdeMrOiqN8_42Q;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rDxIg_HSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rG2qp0nSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rGC-qsHSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rM0bV1HSyEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4r_F_SRnSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rj6yHfnStEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rpWduENpwQdeUs-K0ZLO2XQ;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rt02KDnSxEdaAAACgyZzFrg;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv-0a8pwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv1SXhZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv4V2WZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvVjCBpwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvWgxLZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rv_ZQbZwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvbSq6pwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rvqjUrpwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rwLpXZJwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rwPzQbJwpEbGdrcN5Y29ycA;
/   Mx4rvjldVJwpEbGdrcN5Y29ycA Mx4rwQCfP5wpEbGdrcN5Y29ycA;
/   Mx4rBVVEokNxEdaAAACgydogAg Mx4r2UyxsEJ2EduAAAACs0vk3Q;
/   Mx4riWVFR6HJSpaEaHrcWS3MSA "http://www.w3.org/2006/03/wn/wn20/instances/synset-person-noun-1";
/   Mx4rvcZ1FpwpEbGdrcN5Y29ycA Mx4rv-0a8pwpEbGdrcN5Y29ycA;
/   cyc:CycAnnotations_v1#label "Person"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "human"@en;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rKyCUeJCTQdeS1bGq39eSZw;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rbEfSDn8AEdaAAAABAjVgzA;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rsieVwHWaQdeAhsggL2dmvw;
/   Mx4rvdUGBpwpEbGdrcN5Y29ycA Mx4rzfuG7n8AEdaAAAABAjVgzA;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "layman"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "laymen"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "mortal"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "people"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "mortals"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "persons"@en;
/   Mx4rwLSVCpwpEbGdrcN5Y29ycA "manpower"@en;
/   rdfs:label "person"@en;
/   Mx4rNv0nbm4TTjOp7yhmnzOyqg "http://en.wikipedia.org/wiki/Person";
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rAAnQ5r1TQdeNXYZ5j_YyOQ;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rG2qp0nSxEdaAAACgyZzFrg;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rGC-qsHSxEdaAAACgyZzFrg;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rt02KDnSxEdaAAACgyZzFrg;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rv-0a8pwpEbGdrcN5Y29ycA;
/   Mx4rv86JWpwpEbGdrcN5Y29ycA Mx4rvViWHZwpEbGdrcN5Y29ycA;
/   Mx4rTv-jk9SPTXa991kk5mAvHg "Person";
/   Mx4rvVj1MJwpEbGdrcN5Y29ycA Mx8Ngx4rvcUeB5wpEbGdrcN5Y29ycB4rbqdVPHTAEdaAAACgyZzFrh4rC5KBWupOQdiTk9hzkgQqVQ;
ke$ exit;

Dick McCullough
http://mkrmke.org

#697

From: "Richard H. McCullough" <rhm@...>
Date: Tue Sep 22, 2009 8:37 pm
Subject: mke.php update

rhmcc

Offline

I have added the following to the enumeration of mKR propositions

which are automatically generated for the user:

wholes e.g. person isapart* ?;

parts e.g. person haspart* ?;

attributes e.g. person has ?;

binary relations e.g. person rel ?;

actions e.g. person do ? done;

interactions e.g. person ido ? done;

Dick McCullough
http://mkrmke.org

#696

From: "Richard H. McCullough" <rhm@...>
Date: Tue Sep 22, 2009 7:57 am
Subject: Re: opencyc-latest.owl

rhmcc

Offline

I have merged all GDBM files into the opencyc/latest database,

which can be viewed at

The final .zip file for the database is only 82 MB.

Dick McCullough
http://mkrmke.org

Reply | Forward | Messages in this Topic (3)

#695

From: "Richard H. McCullough" <rhmccullough@...>
Date: Wed Sep 16, 2009 6:31 pm
Subject: Re: mke

rhmccullough...

Offline

Regarding GESS -- the mke online program serves the following functions:

For each view [database]

1) stores propositions in GDBM tables

2) provides numerous mKR language questions and commands to search the tables

You can also run mke offline for testing before installing.

All the GDBM tables are documented in http://mkrmke.net/help/gdbmtable.txt

Regular expressions [for homatch command] are documented in http://mkrmke.net/help/RegularExpression.txt

Details of mKR language are documented in http://mkrmke.org/, especially http://mkrmke.org/doc/MKEtutorial.html

Other details may be found in http://groups.yahoo.com/group/KR-language

A summary of formats, commands, etc. may be found using

mke --help

mke --commands

...

All source code is available for download from http://mkrmke.org/download/

The PHP-mke interface is demonstrated in

http://sematicwww.com/index.php

The view [database] is selected by the environment variables KEDB, VIEW.

Online operation is signaled by the environment variable PHP.

All of the mke programs, databases, knowledge bases, etc. are stored in

http://standardontology.net/mke/

http://mkrmke.net/

The databases are built offline using commands such as

owl2fmt

owl2mkr

ho2gs

bc2gs

gdbmload

newdb

mke

The vardump command can be used to monitor mke progress in building databases.

GDBM databases work fine for GESS (about 50,000 lines input)

MySQL databases are likely required for much larger applications (about 1,000,000 lines input)

My biggest problems in the GESS application were

1) getting Azamat to specify propositions

2) getting Azamat to specify what searches he wants

If you have any questions, just email me.

Dick McCullough
http://mkrmke.org

----- Original Message -----

From: AzamatAbdoullaev

To: paoladimaio10@...

Cc: Richard H. McCullough

Sent: Wednesday, September 16, 2009 8:35 AM

Subject: Re: SPAF

PM: I can find programmers after I receive a project spec, so first I need to know what needs to be done, then I can think of who can do it.

The best adviser here Dick McCullough, he is supposed to be a leader of the programming group, although he is an American and can't formally participate.

I ask Richard to tell something about the GESS project, and what programming works it will need.

We posted some expermental results as Global Entity Search System, which you can test it here: http://semanticwww.Emetasearch. Some comments below.

#694

From: "Richard H. McCullough" <rhm@...>
Date: Mon Sep 14, 2009 1:57 pm
Subject: Re: opencyc-latest.owl

rhmcc

Offline

After correcting several bugs in owl2mkr and mke,

the processing times look very different.

I also had to do GDBM garbage collections more often --

collect on hoindividual table every 5,000 lines.

The mke processing times below are for the input

http://mkrmke.net/knowledge/opencyc/latest.02.owl

http://mkrmke.net/knowledge/opencyc/latest.02.omn

http://mkrmke.net/knowledge/opencyc/latest.02.mkr3

The resulting database

view = opencyc/02

can be explored with

1) first mke version -- 29 hours

basic problem -- values of GDBM tables are strings,

while most mKR propositions use sets.

Updating GDBM tables requires

a) concatentate strings [comma-separated values]

b) parse string to get list

c) convert list to set

d) convert set to string

2) second mke version -- 4.7 hours

Steps b,c,d are deferred until all input has been read.

The final processing is done by

mke --reduce

3) third mke version -- 4.4 hours

Step a is speeded up by storing rdfs:comment [typically very large]

in a separate table, hocomment.

With this final mke version, the principal processing steps are

owl2fmt # .owl -> .omn

owl2mkr # .omn -> .mkr

mke # .mkr -> GDBM tables

mke --collect

mke --reduce

mke --collect

mkzip # GDBM tables -> .zip

Dick McCullough
http://mkrmke.org

Reply | Forward | Messages in this Topic (3)

#693

From: "Richard H. McCullough" <rhm@...>
Date: Thu Sep 10, 2009 9:29 pm
Subject: opencyc-latest.owl

rhmcc

Offline

It is difficult to use this file.

Whenever I want to check something, I am faced with

a name so long I cannot possibly remember it.

I can only copy/paste the name and search the file.

I have to find the label and comment properties

to even know what the name means.

I'm not yet sure whether I will be able to successfully

create GDBM database files for OpenCyc.

It may require MySQL.

In round numbers:

I split the 150 MB [1,800,000 lines] file into 8 parts

of approx 20 MB [250,000 lines] each.

I translated each part to OWL 2 Manchester format,

and then to mKR format. All files are available at

http://mkrmke.net/knowledge/opencyc/

When I used mke to create the GDBM database:

latest.01.mkr2 [very small] finished in 1 second;

adding latest.02.mkr2 finished in 21 minutes;

adding latest.03.mkr2 has repeatedly crashed

because the hoindividual file exceeded 2 GB.

On my last attempt, I did a garbage collection

every 10,000 lines [original setting was 20,000 lines],

and GDBM crashed after processing

49,000 lines in 98 minutes.

Dick McCullough
http://mkrmke.org

Reply | Forward | Messages in this Topic (3)

#692

From: "Richard H. McCullough" <rhm@...>
Date: Tue Sep 8, 2009 8:53 pm
Subject: exact match & regular expression match

rhmcc

Offline

Exact matches are faster & simpler than regular expression matches.

I decided to use separate commands for them

do hofind od concept done; -- exact match

do homatch od concept done; -- regular expression match

Also, I decided not to mix display commands and search commands.

hofind and homatch only list matching concepts. If you want the

do hodisplay od concept done;

command which was previously included, then use

do find and display od concept done;

do match and display od concept done;

Dick McCullough
http://mkrmke.org

#691

From: "Richard H. McCullough" <rhm@...>
Date: Fri Sep 4, 2009 11:12 pm
Subject: OpenCyc in Manchester OWL syntax

rhmcc

Offline

FYI

I split the opencyc-latest.owl file into 8 parts

so I could use the U. of Manchester syntax converter.

Results are in http://mkrmke.net/knowledge/opencyc/.

My next steps will be to convert to mKR

and build a GDBM database for mke.

Dick McCullough
http://mkrmke.org

#690

From: "Richard H. McCullough" <rhm@...>
Date: Mon Aug 31, 2009 3:59 pm
Subject: new GDBM table: hoindividual

rhmcc

Offline

mke now includes the individual or concept distinction.

isu/isp relate individual unit and genus

iss/isg relate species and genus

isa/isc relate individual unit or species and genus

For example, an individual person can be declared using any one of

these mKR statements.

Dick McCullough isu person;

i:Dick McCullough isa person;

person isp Dick McCullough;

person isc i:Dick McCullough;

and the assertion is stored in the GDBM hoindividual table as

hoindividual[Dick McCullough] = +person

hoindividual[person] = -Dick McCullough

Individual persons can be retrieved using any one of

these mKR questions [isa/isc implementation in progress].

? isu person;

? isa person;

person isp ?;

person isc ?;

Dick McCullough
http://mkrmke.org

#689

From: "Richard H. McCullough" <rhm@...>
Date: Mon Aug 31, 2009 7:04 am
Subject: regular expressions

rhmcc

Offline

This new help file

http://mkrmke.net/help/RegularExpression.txt

documents the regular expression match used by the

hofind command of mke.

Dick McCullough
http://mkrmke.org

#688

From: "Richard H. McCullough" <rhm@...>
Date: Sun Aug 30, 2009 4:33 pm
Subject: GDBM table formats and mKR propositions

rhmcc

Offline

This new help file

http://mkrmke.net/help/gdbmtable.txt

documents the GDBM tables used by the mke program.

Note that most tables have + and - values associated with them.

This direction, + [up] or - [down], is used by mke

as it walks up and down the "hierarchy" which is defined

by the table.

"hierarchy" is interpreted very liberally,

and includes things other than the traditional

genus-species and whole-part hierarchies.

For example

concept isa* ?; # walks up to top of genus-species hierarchy

concept isc**3 ?; # walks down 3 levels in genus-species hierarchy

concept haspart ?; # walks down 1 level in whole-part hierarchy

concept has ?; # walks down 1 level in concept-attribute hierarchy

? has gender = female; # walks up 1 level in concept-attribute hierarchy

Dick McCullough
http://mkrmke.org

#687

From: "Richard H. McCullough" <rhm@...>
Date: Sat Aug 29, 2009 11:52 am
Subject: collect -- TAP GDBM database

rhmcc

Offline

FYI

I added a new option

mke --collect

which does a collect on every GDBM table.

For the TAP KB, the size of the database .zip file

was reduced from 52 MB to 10 MB.

Dick McCullough
http://mkrmke.org

#686

From: "Richard H. McCullough" <rhm@...>
Date: Sat Aug 29, 2009 12:51 am
Subject: world.ho

rhmcc

Offline

FYI

Here is the current usecs/world hierarchy.

rhm@rhm8200 /home/azamat/GoDaddy/mke
$ export KEDB=./db
$ export VIEW=usecs/world
$ mke --input "World isc* ?;" >world.ho

$ cat world.ho
World => World, Universe, Existence, Cosmos -- ();
/   Reality => Reality --       ();
//      Entity => Entity --     ();
///         Nature => Nature -- ();
////            Mind => Mind -- ();
/////               Society => Society --       ();
//////                  Technology => Technology --     ();
///////                     IntelligentSystems => IntelligentSystems -- ();
////////                        Cyberspace => Cyberspace --     ();

Dick McCullough
http://mkrmke.org

#685

From: "Richard H. McCullough" <rhm@...>
Date: Thu Aug 27, 2009 2:10 am
Subject: Windows XP/Unicon/MySQL works

rhmcc

Offline

FYI

ODBC now correctly configured on my Windows XP desktop,

as verified by this test program.

Unicon open() aborts if user,password arguments are not present.

# KEHOME/test/mysql.icn
# Aug/26/2009

procedure main(arg)
#==================
local d,dsname,user,password
local dbtabs,dbcols,dbcol
local row
static b,c,dot,EOL
initial {
b := " "
c := ","
dot := "."
EOL := "\n"
}
dsname := "mysql"

user := ""; password := ""
d := open(dsname,"o",user,password) | stop("can't open ",dsname)

dbtabs := dbtables(d)
writes("dbtabs = "); every writes((!dbtabs).name,b); writes(EOL)
dbcols := dbcolumns(d,"phonebook")
writes("dbcols = "); {
        every dbcol := !dbcols do
                writes(dbcol.tablename||dot||dbcol.colname,b)
        }; writes(EOL)

sql(d,"select * from phonebook;")
while row := fetch(d) do {
writes(row.person,c,row.phone,c,row.email,EOL)
}

close(d)
end

Dick McCullough
http://mkrmke.org

#684

From: "Richard H. McCullough" <rhm@...>
Date: Mon Aug 24, 2009 9:17 pm
Subject: re: Variants of Semantic Web Languages in the Real World

rhmcc

Offline

Hi Sandro

This is a brief addendum to the info. in my Aug/10/2009 email.

I have emphasized self-documentation in my new mke command,

even including a list of those mKR language features which are not

currently implemented. Here is a summary

http://mkrmke.net/help.txt

and a screenshot

http://mkrmke.org/homepage/mke.online.jpg

and a working online demo

with example knowledge bases from Cyc, SUMO, TAP, USECS, Tabula Rasa.

Dick McCullough
http://mkrmke.org

#683

From: "Richard H. McCullough" <rhmccullough@...>
Date: Sun Aug 23, 2009 5:22 am
Subject: Re: GDBM garbage collection problem

rhmccullough...

Offline

After a little experimentation, I chose to run my collect every 25,000 lines.

Processed http://mkrmke.net/knowledge/tap/newtap.mkr successfully:

216362 lines in 1 hour.

hogenus GDBM table 22 MB

New TAP GDBM database available at

http://mkrmke.org/download/tap.db.zip 52 MB

Also viewable with mke online at

Dick McCullough
http://mkrmke.org

----- Original Message -----

From: "Clinton Jeffery" <clint.jeffery@...>

To: "Richard H. McCullough" <rhmccullough@...>

Sent: Saturday, August 22, 2009 4:09 PM

Subject: Re: GDBM garbage collection problem

>I haven't studied the implementation. What I think you are saying is that
> replacing a key allocates new disk space, rather than reusing the old space,
> and that the old space is never subsequently used for a later insert or replace.
> This is surprising, I would expect it to be on a "free list" that would get used
> to satisfy a later request.
>
> In looking at the C API, there is a C function that it can use to
> "garbage collect",
> gdbm_reorganize(), and that function is very slow but does what you need. So
> the question is what is the best and most Uniconish way to provide access to
> this function. We could, for example, make it happen automatically, or we could
> make collect(db) do the job.
>
> Clint
>
> On Sat, Aug 22, 2009 at 3:57 PM, Richard H.
> McCullough<rhmccullough@...> wrote:
>>
>> Do you think GDBM will "release" the old file space
>> if I delete key before writing new value?

#682

From: "Richard H. McCullough" <rhm@...>
Date: Sat Aug 22, 2009 5:14 pm
Subject: GDBM garbage collection problem

rhmcc

Offline

There's a clear GDBM garbage collection problem.

Can Unicon tell GDBM to collect garbage?

Here are some numbers.

I reran TAP with hoKeyType = concept.

cd /home/knowledge/tap

export KEDB=./db

gdbmload --genus.species <genus.species.csv

mke --noprompt <newtap.mkr 2>newtap.concept.err

The 2 GB hogenus.pag crash occurs at line 161986 of 216362 in newtap.mkr

Note that the newtap.hogenus.txt table dump is only 3 MB !

See more details below.

rhm@rhm8200 /home/knowledge/tap
$ mke --input "do dump od hogenus done;" >newtap.hogenus.txt
# hoKeyType = concept
$ mke --input "do dump od hovariable done;" >newtap.hovariable.txt
# hoKeyType = concept

$ cat newtap.hovariable.txt
hovariable[$nline] = 161986
hovariable[hoKeyType] = concept
hovariable[$hoindent] = 4
hovariable[$line] = MusicianChayanne isu Musician;
hovariable[$debug] = no

$ wc newtap*
      38      239     1528 newtap.concept.err
      28      210     1305 newtap.gs.err
   55488   166584 3325018 newtap.hogenus.txt
       5       17      166 newtap.hovariable.txt
216362 1036071 9788873 newtap.mkr
271921 1203121 13116890 total

$ mke --database
# hoKeyType = concept
DBDIR=./db
total 2214364
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hoact.dir
-rwxr-xr-x 1 rhm None       3072 Aug 22 06:33 hoact.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hoattr.dir
-rwxr-xr-x 1 rhm None   81181605 Aug 22 06:33 hoattr.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hodef.dir
-rwxr-xr-x 1 rhm None       3072 Aug 22 06:33 hodef.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hoflag.dir
-rwxr-xr-x 1 rhm None       3072 Aug 22 06:33 hoflag.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:58 hogenus.dir
-rwxr-xr-x 1 rhm None 2147621590 Aug 22 06:33 hogenus.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hoiact.dir
-rwxr-xr-x 1 rhm None       3072 Aug 22 06:33 hoiact.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hoinverse.dir
-rwxr-xr-x 1 rhm None       3072 Aug 22 06:33 hoinverse.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hopart.dir
-rwxr-xr-x 1 rhm None       3072 Aug 22 06:33 hopart.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 horel.dir
-rwxr-xr-x 1 rhm None       3158 Aug 22 06:33 horel.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 hosynset.dir
-rwxr-xr-x 1 rhm None   35485052 Aug 22 06:33 hosynset.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:58 hovariable.dir
-rwxr-xr-x 1 rhm None    3129852 Aug 22 09:37 hovariable.pag
-rwxr-xr-x 1 rhm None       3072 Aug 22 05:59 ssdef.dir
-rwxr-xr-x 1 rhm None       3072 Aug 22 06:33 ssdef.pag

Dick McCullough
http://mkrmke.org

#681

From: "Richard H. McCullough" <rhm@...>
Date: Sat Aug 22, 2009 10:48 am
Subject: strange results for TAP KB

rhmcc

Offline

FYI

In a nutshell:

Person isc ?; succeeds [1 level]

Person isc* ?; fails [subhierarchy]

My howalk.icn routines do a depth-first walk.

I believe isc* is silently failing with Unicon stack overflow.

Dick McCullough
http://mkrmke.org

#680

From: "Richard H. McCullough" <rhm@...>
Date: Fri Aug 21, 2009 1:35 am
Subject: Re: TAP GDBM crash

rhmcc

Offline

Looking good.

No GDBM crash.

hogenus table is only 13 MB.

access time is about 1 sec.

Dick McCullough
http://mkrmke.org

----- Original Message -----

From: Richard H. McCullough

To: Clinton Jeffery

Cc: KR-language

Sent: Thursday, August 20, 2009 2:13 PM

Subject: TAP GDBM crash

FYI

I'm dusting off my old ke implementation of relations.

Definition includes key, e.g.

    gs is relation with

        arraymode = gdbm, arraykey = "$1_$2",

        format = [genus:1,species:2],

        meaning = { ... };

and insertion is

    insert(gs,"$1_$2", RELUNIT([$1,$2],";"))

[using encode, decode]

For my current all strings implementation, I can use

    insert(gs,"$1,$2",1)

Hopefully, there will be no crash problem,

just slower access.

Dick McCullough
http://mkrmke.org

#679

From: "Richard H. McCullough" <rhm@...>
Date: Thu Aug 20, 2009 9:13 pm
Subject: TAP GDBM crash

rhmcc

Offline

FYI

I'm dusting off my old ke implementation of relations.

Definition includes key, e.g.

gs is relation with

arraymode = gdbm, arraykey = "$1_$2",

format = [genus:1,species:2],

meaning = { ... };

and insertion is

insert(gs,"$1_$2", RELUNIT([$1,$2],";"))

[using encode, decode]

For my current all strings implementation, I can use

insert(gs,"$1,$2",1)

Hopefully, there will be no crash problem,

just slower access.

Dick McCullough
http://mkrmke.org

#678

From: "Richard H. McCullough" <rhm@...>
Date: Tue Aug 18, 2009 5:58 pm
Subject: creating subhierarchy GDBM database

rhmcc

Offline

FYI

This is how I created the 4 subhierarchy databases that you wanted.

# online: save hierarchy database

$ cd mke/db/usecs/entity

$ mkzip E18

# download and install in /home/ke/db

$ cd /home/ke/db

$ unzip E18.zip

# offline, create each subhierarchy

$ mke

ke$ do hodelete od BOTTOM done;
ke$ BOTTOM isa ?;
BOTTOM => BOTTOM, Reality --    (root of hierarchy);
ke$ TOP isc ?;
TOP => TOP, the World, Existence, Universe --   (top of hierarchy);
/      World => world, resource, existence, universe --    ( );
ke$ exit;

$ mke --input "Substance isc* ?;" >usecs.substance.ho

$ mke --input "State isc* ?;"         >usecs.state.ho
$ mke --input "Change isc* ?;"      >usecs.change.ho
$ mke --input "Relation isc* ?;"     >usecs.relation.ho
$ mv *.ho .../tmp/

# offline, create each subhierarchy database; upload & install each one

$ cd ../tmp

$ d2u usecs.substance.ho

$ vi usecs.substance.ho # add tab separators

$ newdb usecs.substance.ho

# upload & install ../db/new.db.zip in mke/db/usecs/substance

...

Dick McCullough
http://mkrmke.org

#677

From: "Richard H. McCullough" <rhm@...>
Date: Tue Aug 18, 2009 2:47 pm
Subject: mke software & data status

rhmcc

Offline

FYI

I have been doing lots of small enhancements & bug fixes to mke.

I have been updating

http://mkrmke.org/download/mkewin.zip

http://mkrmke.org/download/mkefed.zip

every day.

I am working with a new copy of mytap.mkr, currently

http://mkrmke.net/knowledge/tap/newtap.mkr

In addition to the redundancy in the names, which

I mentioned previously, I am finding

quote errors -- unbalanced, unescaped

redundant properties, e.g.

label = "Doe, John"

name = "Doe,_John"

In my last run yesterday, result was still

GDBM hogenus 2 GB crash after 30 minutes

P.S. One of my mke enhancements was

some status info. for mke execution

hovariable["$nline"] = current input line number

hovariable["$line"] = current input line

varspy program dumps hovariable table

Dick McCullough
http://mkrmke.org

#676

From: "Richard H. McCullough" <rhm@...>
Date: Tue Aug 18, 2009 1:44 pm
Subject: alternative data structures

rhmcc

Offline

some general thoughts on ke/mke data structures

1) the current mke problem

a) RAM efficient -- only one GDBM table per relation -- no tables per concept

b) I am using one set per concept to save genus-species info

c) that one set is inefficiently implemented - as a string [GDBM value]

d) runs like a dog for large number of concepts [instances]

e) if I used one table per concept for genus-species info,

it would be execution-time efficient

but many GDBM tables might be a problem

2) the original ke problem

a) I use many (dozen plus) RAM tables per concept

b) execution is fast for less than 1000 concepts

c) runs like a dog for large number of concepts because

it uses too much RAM.

All this gets me thinking about "virtual tables"

and how best to implement them.

Implementation-independent software

[RAM or GDBM or SQL or ....]

would be nice.

We might distinguish between "tables"

single column

Unicon type

and "relations"

multiple column

SQL type

P.S. I noticed -- in your Unicon book -- you

associate table rows with records.

I have been associating rows with lists,

which fits nicely with $n convention of

Unix shell and mKR and awk and ....

Dick McCullough
http://mkrmke.org

#675

From: "Richard H. McCullough" <rhm@...>
Date: Mon Aug 17, 2009 12:30 pm
Subject: usecs.E17.zip

rhmcc

Offline

I made a few hierarchy changes this morning.

Latest USECS GDBM database:

http://mkrmke.org/download/usecs.E17.zip

Latest version installed in

Dick McCullough
http://mkrmke.org

#674

From: "Richard H. McCullough" <rhm@...>
Date: Mon Aug 17, 2009 6:39 am
Subject: Re: mytap.mkr GDBM database

rhmcc

Offline

1st new results -- for CSV files

input is roughly

egrep ' isu | iss ' mytap.mkr | sed 's/ iss / isu /' |

sed 's/ isu /,/' | sort -u |

awk -F, '{print $2 FS $1}' >tap.gs.csv

results:

rhm@rhm8200 /home/knowledge/tap
$ wc tap.gs.csv
73665 73668 2444011 tap.gs.csv # input CSV -- 73665 lines -- 2 MB

rhm@rhm8200 /home/knowledge/tap
$ date;gdbmload --genus.species <tap.gs.csv;date
Sun Aug 16 22:48:06 PDT 2009
##### main(arg[1] = --genus.species) #####
##### genus_species_main(arg[1] = --load) #####
##### load_hogenus() #####
gdbm fatal: lseek error.
Sun Aug 16 22:53:27 PDT 2009

rhm@rhm8200 /home/knowledge/tap
$ ls -l $KEDB
total 2097268
-rwxr-xr-x 1 rhm None 3072 Aug 16 22:48 hogenus.dir # 3 kB
-rwxr-xr-x 1 rhm None 2147597033 Aug 16 22:53 hogenus.pag # 2 GB output

As expected, processing CSV is faster than subject-verb-object

Only took 5:21 min:sec to reach 2 GB crash

You'll notice that I didn't load the structure.ho hierarchy.

Instance categories are:

rhm@rhm8200 /home/knowledge/tap
$ mke
ke$ Resource isc ?;
Resource ;
ke$ do hotop done;
0 genera for BusinessMagazine;
0 genera for SnowsportMagazine;
0 genera for WesternRegionalMagazine;
0 genera for GameMagazine;
0 genera for "CMUSCS_ResearchArea";
0 genera for PhotographyMagazine;
0 genera for HuntingFishingMagazine;
0 genera for Country;
0 genera for HistoryMagazine;
0 genera for Perennial;
0 genera for AfricanAmericanMagazine;
0 genera for ConsumerElectronicsCorporation;
0 genera for CMUPerson;
0 genera for CollectiblesMagazine;
0 genera for WomensFashionMagazine;
0 genera for Author;
0 genera for ChouChouBabyDoll;
0 genera for UnbelievablySoftBabyDoll;
0 genera for ComputerScientist;
0 genera for Musician;
0 genera for BoatingMagazine;
0 genera for Movie;
0 genera for Cartoon;
0 genera for Book;
0 genera for MusicSceneMagazine;
0 genera for SpiritualityMagazine;
0 genera for HorseRidingMagazine;
0 genera for Chemist;
0 genera for SportMagazine;
0 genera for Territory;
0 genera for SoftwareCompany;
0 genera for ComputerEquipmentManufacturer;
0 genera for BrainBoardGame;
0 genera for MovieMagazine;
0 genera for ElectronicGamingMagazine;
0 genera for MusicalInstrumentMagazine;
0 genera for GolfMagazine;
0 genera for Athlete;
0 genera for RoseBush;
0 genera for City;
0 genera for WomensMagazine;
0 genera for HomeGardenMagazine;
0 genera for CMU_RAD;
0 genera for Architect;
0 genera for Composer;
0 genera for Annual;
0 genera for PlayingCardGame;
0 genera for SocioReligiousEvent;
0 genera for AutomotiveMagazine;
0 genera for UnitedStatesCity;
0 genera for MysteryBoardGame;
0 genera for AudioEquipmentMagazine;
0 genera for FishingMagazine;
0 genera for PersonalComputerGame;
0 genera for ChildrensMagazine;
0 genera for DesignDecoratingMagazine;
0 genera for SpecialtyFoodMagazine;
0 genera for CMUGraduateStudent;
0 genera for MotorcycleMagazine;
0 genera for Actor;
0 genera for Person;
0 genera for NewsMagazine;
0 genera for NatureMagazine;
0 genera for "CMUFace";
0 genera for ComicStrip;
0 genera for CommunicationMedium;
0 genera for CMUFaculty;
0 genera for SurfingMagazine;
0 genera for Evergreen_Shrub;
0 genera for MovieDirector;
0 genera for Gender;
0 genera for CrosswordMagazine;
0 genera for MusicGroup;
0 genera for Herb;
0 genera for CookingMagazine;
0 genera for WoodworkingMagazine;
0 genera for Vine;
0 genera for PetBirdMagazine;
0 genera for EntertainmentMagazine;
0 genera for MensPornographyMagazine;
0 genera for FamilyParentingMagazine;
0 genera for FashionModel;
0 genera for Religion;
0 genera for MidwestRegionalMagazine;
ke$

Dick McCullough
http://mkrmke.org

----- Original Message -----

From: Richard H. McCullough

To: Clinton Jeffery

Sent: Sunday, August 16, 2009 10:11 PM

Subject: mytap.mkr

FYI

I spent a few minutes browsing this file, and I found

some unusual things.

1) very large number of instances, which means that

    hogenus[genus] = -species1,-species2, ...,

will be a very long string.

2) some instance names have extra characters, of form

    "AthleteDoe, _John" isu Athlete;

3) and extra links. 2) is sometimes accompanied by

    "AthleteDoe, _John" iss Athlete;

I'm going to do some filtering on this file, to see if

1) I can avoid the 2 GB crash

2) I can get any other insight into why hogenus is so big.

Dick McCullough
http://mkrmke.org

#673

From: "Richard H. McCullough" <rhm@...>
Date: Sun Aug 16, 2009 11:20 pm
Subject: connecting upper & lower ontologies

rhmcc

Offline

FYI

I am making very rapid progress in connecting the last 50 nogenus concepts.

I am using mke assertions and hierarchy editing commands:

species isa genus;

rhm@rhm8200 /home/rhm
$ mke --commands
dump
hobottom
hodelete        => do hodelete od species [from genus] done;
hodisplay
hofind
homove         => do homove od species from genus 1 to genus 2 done;
horeduce
hotop            => mke --input "do hotop done;" > nogenus.txt
print
read
reset flag
select
set flag
size
write

Here are a couple of snips from my last few minutes of activity.

ke$ ss_012209 isa* ?;
ss_012209 => dissemble, pretend, act -- (behave unnaturally or affectedly; "She's just acting");
\   TOP => TOP, the World, Existence, Universe --       (top of hierarchy);
ke$ do homove od ss_012209 from TOP to Act done;
ke$ ss_012209 isa* ?;
ss_012209 => dissemble, pretend, act -- (behave unnaturally or affectedly; "She's just acting");
\   Act => act --       ( );
\\      Action => action, activity, process -- ( );
\\\         Change => change -- ( );
\\\\            Entity => entity, being, thing --       ( );
\\\\\               Reality => reality --       ( );
\\\\\\                  World => world, resource, existence, universe --        ( );
\\\\\\\                     TOP => TOP, the World, Existence, Universe --       (top of hierarchy);
ke$ Interaction isa* ?;
Interaction ;
ke$ Interact isa* ?;
Interact => interact -- ( );
\   Relate => relate -- ( );
\\      Action => action, activity, process -- ( );
\\\         Change => change -- ( );
\\\\            Entity => entity, being, thing --       ( );
\\\\\               Reality => reality --       ( );
\\\\\\                  World => world, resource, existence, universe --        ( );
\\\\\\\                     TOP => TOP, the World, Existence, Universe --       (top of hierarchy);
ke$ do homove od ss_008667 from TOP to Interact done;

ke$ ss_008667 isa* ?;
ss_008667 => compete, vie, contend --   (compete for something; engage in a contest; measure oneself
against others);
\   Interact => interact --     ( );
\\      Relate => relate --     ( );
\\\         Action => action, activity, process --      ( );
\\\\            Change => change --     ( );
\\\\\               Entity => entity, being, thing --   ( );
\\\\\\                  Reality => reality --   ( );
\\\\\\\                     World => world, resource, existence, universe --    ( );
\\\\\\\\                        TOP => TOP, the World, Existence, Universe --   (top of hierarchy);

Dick McCullough
http://mkrmke.org

#672

From: "Richard H. McCullough" <rhm@...>
Date: Sun Aug 16, 2009 1:08 am
Subject: Fw: connecting upper & lower ontologies

rhmcc

Offline