Wednesday, August 06, 2003

Open Source for Education

Sharing the Code "While open-source-code projects like Linux have long been in the public eye, colleges and universities are now beginning to consider collaboration on similar efforts as a relatively cheap, effective way to meet their specialized software and computing needs."

I only mention this article because it lists DSpace - nice to see Semantic Web technology being considered usable enough for deployment.

Tuesday, August 05, 2003

RDF - A Space Odyssey

The Baconizer database contains 472,772 books, CDs, and videos spanned by 3,787,049 links. According to the FAQ these are taken from Amazon's links to related products. It then uses these links to find an association between two items. It's the sames as the 6 degrees of Kevin Bacon but with products instead of people.

These queries are made against a graph. What I'd really like to see is if an RDF triple store could beat the Oracle database at these kinds of queries.

Here's an example of "Practical RDF" to "2001 - A Space Odyssey".

Monday, August 04, 2003

Software History Repeating Itself

Platform and Community Observations from a Mainframe Software Pioneer "We so often trace our antecedents back simply to the Unix heritage, or the Lisp hacker heritage. But when I've talked to IBM old-timers, they make clear just how many of the social dynamics and collaborative software development paradigms of the early mainframe era resemble the open source tradition."

I've been reading From Airline Reservations to Sonic the Hedgehog : A History of the Software Industry which describes the early history of mainframe development. A group called SHARE whose only qualification was that they were the owners of the new 704 IBM mainframe. In it's first year of operation they claimed to have saved members around $1.5 million dollars (1950s dollars) and had shared around 300 programs.

The development of FORTRAN apparently created a "network effect". Users made an investment in FORTRAN because it was the first reliable language (increasing programmer productivity by 5 to 10 times). This was quite impressive as up to three quarters of the cost of running a computer (staff and machine time) was taken up writing programs - not running them. This led to other manufacturers providing FORTRAN for their machines and users sharing code amongst each other. Programs were considered free - they had no intrinsic value.

Sunday, August 03, 2003

Open Innovation

Are You Open To Innovation? "But the idea behind open innovation is that there are too many good ideas held by people who don't work for you to ignore. Even the best companies with the most extensive internal capabilities have to take external knowledge and ideas into account when they think about innovation. So good ideas can come from outside as well as inside. And they can go to market not only inside your company, but also outside, through others...Of the things that have to become a key focus, one is to be much more externally aware and externally focused before you undertake internal projects. You want to take internal projects in hand to fill a gap that's not being addressed outside or to put the pieces together in new combinations in systems or architectures that are very useful."

Interesting that Procter and Gamble will license technology to competitors and that IBM is the biggest reseller of Sun hardware. Unfortunately, he called Linux a computer language but he's still making valid points here.

Quick MBA's summary on Open Innovation "The research from PARC spawned many successful products, but the shareholders of Xerox did not benefit as much as others did. Employees who worked on promising technologies departed to form start-up companies, many of which, such as 3Com and Adobe, acheived much success. In fact, the market capitalization of Xerox's spin-offs exceeded that of Xerox itself."

Saturday, August 02, 2003

Data Federation

Can XML solve data federation conundrum? "Snapbridge Software, a start-up company based in San Diego, claims to have solved the problem of enterprise data federation with a combination of XML standardization and algorithms developed by its engineering team...The product he helped develop, Snapbridge FDX, is in limited release at “Fortune-class” companies in the financial, publishing, supply chain management and telecommunications industries, with an official launch set for this fall, he said."

Technology "The Semantic Objects that invoke the XML Processing within Snapbridge FDX provide interfaces that allow external entities--web browsers, applications, spreadsheets, databases, and web service--to not only view the results of data federation, but be able to update the data as a transaction and have those updates be applied to external systems."

Friday, August 01, 2003

More Machine Learning Algorithms

The people working on Weka Machine Learning Project have been busy. This includes an implementation of Learning Vector Quantization algorithms based on the author's understanding of the theory outlined in "Self Organising Maps" by T. Kohonen. A list of all the tools based on Weka is available here.

I've also come across an old series of articles about Instance Based Learning which includes Java source.

Thursday, July 31, 2003

Is RDF Ready?

"Not long ago, Marc Canter, one of the early founders of Macromedia, talked about RDF and the Semantic Web in his weblog. Specifically, he wrote:

"I've been spending more and more time trying to grok the RDF folks. I have to say I like what I see and hear, but what I don't see are many apps and services actually up and running and working.

...

We have a saying over here: "put up or shut up." I'm still looking for two different RDF apps or services to work together in some meaningful way. Then bring on the books.""

"Plugged In Software's Tucana Knowledge Store provides sophisticated knowledge-based querying of large stores of data, again based on RDF.

These companies are just the first to start looking at RDF and the RDF data model for use in large-scale, sophisticated applications. And then there's the Semantic Web."

http://www.xml.com/pub/a/2003/07/30/practicalRDF.html

Wednesday, July 30, 2003

Resources on Resources

* Vicious Circle
* On Resources
* Re: httpRange-14
* Semantic Web for Poets: FOAF, Flocking, and the Semantics of Starlings
* On Resources
* Some ramblings on URIs and identity

Fiddling

The Future of Human Knowledge: The Semantic Web "For some, the move to a smarter Web is taking far too long. "The Semantic Web might be a cure for our e-commerce ills, but for many businesses, waiting around for it isn't an option...Some e-commerce companies -- impatient at the progress of the Semantic Web project -- are looking into other stop-gap technologies to meet their needs today."

Which Web? "Berners-Lee's latest claim seems to forget that a huge group of people finds the Traditional Web more than adequate for their needs. Some of those folks even do Web Services-like things with REST-based approaches that more closely follow the patterns laid down by the traditional Web. Some of them use XML (and even at times RDF) to exchange semantically-rich information between computers without needing the full power of the Semantic Web. The Traditional Web may be no good to the W3C's director or its members any longer, but it's still good for a lot of us."

Blog Mapper

RDF Mapper "RDFMapper is a web service that searches an RDF file for resources with geographic locations, and returns a map overlayed with dots representing located resources."

Tuesday, July 29, 2003

DVDs the Rosetta Stones of the 21st Century

From Slashdot Romancing the Rosetta Stone "Och's method uses matched bilingual texts, the computer-encoded equivalents of the famous Rosetta Stone inscriptions. Or, rather, gigabytes and gigabytes of Rosetta Stones.

"Our approach uses statistical models to find the most likely translation for a given input," Och explained

"It is quite different from the older, symbolic approaches to machine translation used in most existing commercial systems, which try to encode the grammar and the lexicon of a foreign language in a computer program that analyzes the grammatical structure of the foreign text, and then produces English based on hard rules," he continued.

"Instead of telling the computer how to translate, we let it figure it out by itself. First, we feed the system it with a parallel corpus, that is, a collection of texts in the foreign language and their translations into English."

Cool and I know just where to get them from, DVDs. Websites provide subtitles for DivX (like the Princess Bride) - they're great because they're indexed. For the record the Spainish version (see the DVDs link) is: "El m·s famoso es no involucrarse en una guerra terrestre en Asia.".

Monday, July 28, 2003

WWW2 - The Search for Shared Meaning

How the Semantic Web will scale: "Actually, I expect the web to have different order at different scales. A fractal system has similar amounts of organization showing up in a similar way at different scales...Every time a message sent by one is inconsistent with some interpretation the other had been considering the second agent throws the interpretation away. So we end up with a concept of "means the same thing".

When more than two people do it, then we call it a community, or a movement, or whatever."

Sounds a lot like this: "In the Semantic Web, as in life, you don't have to believe everything everybody says forever. If you are deeply cynical, then don't believe what anyone says. Still, the Semantic Web technologies could be of use. You could use your own text mining tool to extract metadata (unlike the document's own data in the meta tag). You can then combine this with other document's metadata and create your own ontology. You can use ontologies to further classify other documents or sets of documents.

If you can trust other people and their metadata extraction then things get even better or even exponentially better as you trust more (people, groups, companies, etc.) and/or use more tools..."

I hope I've got it...

New version of 3Store

3store is a scalable RDF triplestore and query engine, made available
under the GNU General Public Licence and funded by the AKT Consortium
http://www.aktors.org/

It is known to scale well to KB's of >10 million triples and this version
is running as the production RDF KB for the AKT project.

New features:
* Produces all RDF entailments except RDFS 10 (ContatinerMembershipProperty)
* Supports model queries via a 4th RDQL pattern member
* Interactive and batch mode RDQL query tool (tstore_rdql)
* Perl RDQL interface module
* Supports multiple RDF databases on one machine
* Comparision operators in RDQL queries (> and <)

Several parsing and crash bugs have been fixed in the engine.

http://triplestore.aktors.org/~swh/3store/

The Periodic Table

Tom Lehrer's The Elements in Flash format.

Sunday, July 27, 2003

Various Articles

Computer Visions: A Conversation with David Gelernter "The Linda-Jini technology and Linda-JavaSpaces technology connections seem straightforward. In many ways, Sun is the leading intellectual force in the software world; both Jini technology and JavaSpaces technology are systems I admire highly, and I'm proud that our ideas were useful."

An Open Source Strategy for the Open Group "But sorry, vendors! The easy times are over. A market that embraces Open Source is a highly competitive market, and you'll have to work harder for the customer."

RDF tools are beginning to come of age "Redland is a C-based toolkit with many language bindings, including Python, Perl, and Java. It's comprised of an RDF parser, raptor, and a data store. The store currently uses Berkeley DB files, but support for underlying SQL stores is underway. For my example, I'll use the Python bindings to Redland."

RDF is a Web technology

Missing isn't broken: data validation and freedom on the Semantic Web "Missing isn't broken. In the general case, you are free to say as much, or as little, in your RDF document as you like. RDF vocabularies such as FOAF, Dublin Core, MusicBrainz, RDF-Wordnet don't get to tell you what to do, what to write, what to say. Instead, they serve as an interconnected dictionary documenting the meaning of the terms you're using in your RDF documents."

"If the stark notion of 'valid -vs- invalid' document checking doesn't make sense in the decentralised Semantic Web environment, how can we make things easier for developers who are trying to work with this free-flowing mix of RDF markup? If nothing is mandatory, then how can they write code that knows what to expect?.

There are several answers here. The first is that, if we want this to scale to the planet, we have to accept that one size won't fit all, that different parties will want to say quite varying things in their FOAF documents, and that our ability to impose our views on their documents is limited."

Friday, July 25, 2003

The Cult of Tim

Social Meaning and the Cult of Tim "Perhaps the most disturbing aspect of the entire social meaning debate is the degree to which people uncritically defer to Berners-Lee's "intuition" and "vision", that is, to his admittedly incompletely expressed idea about the Semantic Web. Few people think that Berners-Lee's ideas about the Semantic Web are perfectly or completely formed. Everyone, including Berners-Lee himself, agrees that they are intuitions, which implies the idea that he can see further than he can say, that he can reach further than he can grasp, at least for now.

One obvious point to make is that there are a lot of people trying to help Berners-Lee realize his intuited vision and that he wields more influence and authority over this complex process than any other single person. Perhaps that is perfectly appropriate. However, the problem arises when other people, who have less moral authority, disagree with Berners-Lee. I have heard it said several times, although few people seem willing to commit to this view publicly, that Berners-Lee should be exempt from public criticism because the realizability of the Semantic Web rests upon Berners-Lee's reputation more than upon any other single factor. "

As Berners-Lee says:
" ...we are not analyzing a world, we are building it. We are not experimental philosophers, we are philosophical engineers. We declare "this is the protocol". When people break the protocol, we lament, sue, and so on. But they tend to stick to it because we show that the system has very interesting and useful properties (emphasis added).

The architecture...defines an "authoritative" or "definitive" meaning, to which "meaning" in wittgensteinian sense and "intended menaing" in [an] ethical or legal sense generally approach as closely as they can, and close enough for the system to work and be unbelievably useful to millions of people. "

I'm of the, obviously ignorant, opinion that this is a engineering problem that will be fixed or continue to evolve to a better overall solution. Instead of arguing about this I'm thinking "killer app".

Tim Bray: "Whereas I’m repeatedly on the record as being more than a bit baffled by what the argument is about, and have hinted unsubtly that maybe it’s at the angels-on-the-head-of-a-pin level, a lot of people who are demonstrably smart care a whole lot about it. Anyhow, I can’t ignore it as long as I’m on the TAG, which is at least until we get that damn Architecture document shipped or it’s clear we’re not going to."

The ESW Wiki's entry on the Social Meaning Group has some background too.

SOsim

A SIMULATOR SUPPORTING LECTURES ON OPERATING SYSTEMS "The SOsim has been used at the CS department of Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Brazil. There it was able to clearly demonstrate how a simple OS lecture can be improved by showing those aspects demanded in the complete understanding of the subject. In this way, the teaching and learning process becomes far more efficient."

Homepage (English translation). Developed using Delphi, it runs on Windows.

Wednesday, July 23, 2003

Various Updates

Classifier4J 0.3 "I now have Classifier4J and nntp//rss working together to do Bayesian classification of RSS feeds."

RDF extraction from HTML "Currently it extracts a set of blurbs of RDF and a list of URI's it believes contain RDF. Currently the only documents parsed are HTML.

There are a great many ways to include RDF in HTML files. I located one summary of possible methods. I am also aware that Creative Commons advocates storing the RDF that describes the license for a page in a comment tag."

It's official - we are not stupid! Is another commentry on Mark Butler's paper.

Even Primates use Macs

Primate Programming: The Evolution of IT "Primate Programming Inc, has received 10 million in 1st round financing from five Menlo Park venture capital firms. That first chimp, named Brainerd, is now leading several primate-only software development teams at the company’s headquarters...Bajek said he first got the primate programming (PP) idea after learning about Koko, a female gorilla that used an Apple Mac to communicate with her handlers. Koko held regular webchats on the Web and became famous for her utter mastery of language. One surprise is that Koko is now demanding to move to Maui, Hawaii. “Prima donna” behaviors in programmers are well known, but no one saw this one coming from a primate just starting out in the business. "