Planet CherryPy

Robert Brewer: Zen of CherryPy video

fumanchu — 2010-03-12T02:29:40+00:00

My PyCon 2010 talk video is up. Enjoy: The Zen of CherryPy

Kevin Dangoor: 4th anniversary MichiPUG meeting tomorrow!

Kevin Dangoor — 2009-09-02T17:38:32+00:00

I kicked off the Michigan Python Users Group (MichiPUG) in September 2005, so this month’s meeting marks 4 years since the group began!

This month’s meeting is going to be one of our “topic free” meetings. Despite the lack of a topic, we never have trouble finding Python things to discuss. If you’re going to be around Ann Arbor Thursday evening and have a burning Python question, do stop in!

The meeting will be at 7pm at SRT Solutions in downtown Ann Arbor. Parking is free and easy next to City Hall a couple blocks north (on Ann St.).

This month, I am stepping aside as the de facto leader of the group. While I am still a Python fan and heavy user, my interests have branched out enough that I plan to devote my rather limited “user group time” elsewhere. Stay tuned for more on that soon. Mark Ramm will be taking over my duties as “the guy who sends the monthly ‘what’s our topic?’ email message”.

I’m almost certainly going to be arriving late to tomorrow’s meeting, but I do hope to catch up with folks for drinks afterwards at the very least! See you there!

Kevin Dangoor: Python packaging/install: what I want

Kevin Dangoor — 2009-08-28T18:48:51+00:00

Python packaging and deployment can be annoying. It’s been nearly 4 years since I released the first TurboGears release as an early adopter of setuptools/easy_install. Since then, there’s been the release of virtualenv, pip and zc.buildout. Somehow, it still seems like more trouble than it should be to get development and production environments set up.

On Bespin, I’ve been using a combination of virtualenv and pip (scripted with Paver) in development and production environments. But, I’ve found pip –freeze to be nearly unusable.

My Ideal World

After monkeying with this stuff a fair bit over the past few years, I have an idea of what I’d really like to have but I don’t think anyone’s working on it. I’d love to hear contrasting opinions or learn about projects that I’m not aware of.

Multiple version installation into global site-packages, as easy_install currently works (put the active package in the .pth file)
The better error reporting of pip (pip doesn’t meet my first desire, though, because it installs as single-version-externally-managed)
A tool to manage the installed packages (uninstall, select a different version)
In addition to a global site-packages, it would be nice to be able to specify a different site-dir for machines where I don’t have or don’t want to use root access
virtualenv that behaves like –no-site-packages but knows where site-packages (or the other site-dir) is
That tool that manages installed packages can selectively install specific versions of packages into the virtualenv by adding pointers in the .pth file that point to the site-packages directory
You can also install only into the virtualenv if you wish.
Install packages in that manner from a list of requirements (as with pip’s requirements file)
A way to freeze the currently set installed into the virtualenv as a new requirements file
An optional cache of all of the original sdists of the installed packages

pip is close to being usable, except freeze doesn’t work. zc.buildout is close to being usable, too. I think there’s a “freeze” like plugin for it, but I don’t know how well it works. I don’t like zc.buildout quite as much as virtualenv, and I see that people even use virtualenv+zc.buildout to eliminate site-packages from leaking in. I also find that it leaves tons of old packages around in every buildout, again with no way to manage them.

What I’ve found using both zc.buildout and pip is that they are slow and annoying, because they’re constantly reinstalling things that I already have. The main reason for having a shared site-packages as I suggest above is not to save on disk space, but to save on time. In development, I want to be able to update to the latest versions of packages quickly, installing/building only the ones that have changed. How fast something runs changes how you use it, and I know that the scripts that I have for updating development and production environments reflect that.

So,I think the main thing that I’m looking for is a new tool to manage the packages that I have installed globally and within virtualenvs. Are there tools out there that are heading down this path at all?

Also, I understand the starting point that Tarek is taking with Distribute (splitting it up into logical pieces), but is there any roadmap for where it’s going to go functionally from there? Or is the intention purely that tools like the one I’m angling for will be written against the newly refactored libraries? I do know about the uninstall PEP, and that’s pleasing.

Kevin Dangoor: One Python-based version control system to rule them all!

Kevin Dangoor — 2009-08-15T02:35:31+00:00

We’ve just released Bespin 0.4, the major new feature of which is the first bit of the collaboration feature. Bespin 0.4 includes a ton of other changes, including one that I’m going to focus on here: Subversion support, which Gordon P. Hemsley kicked off for us a few weeks back.

Bespin’s initial version control support showed up in 0.2 with support for Mercurial. Knowing that we wanted to support multiple version control systems (VCS), I took an unorthodox approach from the beginning. Rather than providing the “hg” commands that people know and love, I created a separate set of “vcs” commands. Ultimately, we want to make it easy to grab a random open source project of the net and start hacking on it. Using the “vcs” commands, for the most common version control operations you won’t even have to think about which VCS is used by a given project.

I can run “vcs clone” (“vcs checkout” also works) to check out Bespin (in a Mercurial repository), Paver (in a Subversion repo) and hopefully soon Narwhal (in a Git repo). Also new in Bespin 0.4: Bespin’s command line has been tricked out to be able to have fancier interactions with commands, so you can enter all of the extra information that Bespin needs for checking out a repository right in the output area.

If you’ve used Subversion and one of the Distributed VCSes, you’ll know that they have a different model. The DVCSes do almost everything in a local repository copy and only talk to a remote server for push/pull. That’s actually true of Subversion as well, with one notable exception: commit. For Subversion, the “vcs commit” command will simply save your commit message for later. When you run “vcs push”, that is when an actual “svn commit” operation is run.

What’s neat about the “vcs” commands is that they operate the same from VCS to VCS. svn doesn’t have a feature to “add all files that are unknown”, whereas Mercurial does. “vcs add -a” operates the same on both systems.

If you’re interested, you can also use these commands on the command line by installing the Über Version Controller (uvc) Python package. After doing so, you can head into a random Subversion or Mercurial working copy and type “uvc status” to see what’s different. I will note that the command line tool has been, um, lightly tested since uvc is mostly used as a library for Bespin at this point.

One final note: Bespin will soon also support native “svn” and “hg” commands so that you can stick to commands and options you’re familiar with or for performing more complex operations that don’t have equivalent “vcs” commands.

You can learn more about version control in Bespin from this section of the User Guide.

Uche and Chimezie Ogbuji: Magic sets, DLP, and other strange ways to implement semantic web expert systems

2009-07-20T20:00:07+00:00

I just finished some changes to python-dlp including a modification to
FuXi that includes an implementation of the Magic Set Transformation
(MST) method for RIF-like horn clauses. The most useful, immediate
value this has for me is to be able to (essentially) implement a DLP
(description logic programming) entailment regime for a SPARQL query
service.
>

Consider the test case for the SymmetricProperty OWL test.
>

The base facts are:
>

first:Ghent first:path first:Antwerp .
first:path a owl:SymmetricProperty
>

The goal we are trying to prove is:
>

first:Antwerp first:path first:Ghent
>

I.e., a user wants to query an RDF dataset that includes an RDF graph
with the above statements and is expected to implement an entailment
regime for OWL-DL RDF such that the following query gives a positive
answer:
>

ASK { first:Antwerp first:path first:Ghent }
>

The general pD* rule that would normally apply in helping answer this query is:
>

{?P a owl:SymmetricProperty. ?S ?P ?O} => {?O ?P ?S}.
>

Re-written in a familiar (prolog-like) RIF-BLD syntax:
>

Forall ?P ?O ?S ( ?P(?O ?S) :- And( owl:SymmetricProperty(?P) ?P(?S ?O) ) )
>

In order to maintain consistency, a rule-based engine that used this
clause to implement the definition of a symmetric property would need
to fire it for *every* triple in the fact base (in order to properly
calculate the herbrand base) because of the 2nd triple pattern in the
body / antecedent / left-hand-side of the rule: ?S ?P ?O
>

However, the DLP approach that converted tree-based OWL axioms into
colloquial horn clauses would allow us to use (instead) a
domain-specific rule:
>

Forall ?Y ?X ( first:path(?Y ?X) :- first:path(?X ?Y) )]
>

This rule is domain-specific in the sense that it only applies to
instances of the first:path predicate rather than for every predicate.
As a result of this transformation, the procedural evaluation of the
rule for symmetry has been reduced from the worst case to only the
fraction of the RDF dataset concerning first:path statements.
>

So, a knowledge base that could exhaustively evaluate rules in a
top-down fashion (via 'forward chaining') prior to bringing up the
SPARQL service could answer that question against the (smaller)
entailed RDF graph.
>

However, with the MST implementation, if the query was known a priori
the ruleset can be modified into a version that further restricts the
amount of redundant work done during the inference process. For
example, even if the SPARQL service is known to never have to answer
that query, the colloquial rule above would still be needed by a niave
implemenation and would apply to every statement that used the
first:path predicate.
>

>

The diagram above is a Graph-viz rendering of a Proof Markup Language
(PML) proof tree generated by taking the colloquial rule, modifying it
using the MST algorithm, evaluating the base facts against the
ruleset, and adding an RDF statement that 'triggers' the
backward-chaining process. Fuxi includes a nice set of utilities for generating proof tree vizualizations.

Essentially, performing a top-down (or
forward chaining) evaluation of the rules and the facts simulates a
backward-chained proof.
>

Below are the 3 rules that replace the original domain-specific rule:
>

:path_magic(?LOC1 ? LOC2) :- And( :path_magic(?X ? LOC2)
:path_bf(?X ? LOC1) :path_magic(?X) )
:path_magic(?X) :- :path_magic(?X ?LOC)
:path(?X ?LOC1) :- And( :path_magic(?X ? LOC1) :path_magic(?X)
:path(?X ?LOC2) :path_magic(? LOC2 ? LOC1) :path(?LOC2 ?LOC1) )
>

And finally, the trigger for the proof is the following RDF statement:
>

first:Antwerp first:path_magic first:Ghent
>

The first two rules, pass through information about the sub-goals of
the query and essentially block the final rule from taking effect
until the trigger is added to the fact graph. It is clear to see that
the 3rd rule, will no longer apply to every RDF statement with a
first:path predicate, but rather only statements of that kind where
the subject and / or object terms are part of a query. So, for a
SPARQL service where we do not expect to answer queries that rely on
supporting symmetric properties in the first:path predicate, no
calculations will be performed and no unnecessary RDF statements will
be entailed.
>

I hope to write a bit more about some of the benefits of a Python
toolkit for building Semantic Web expert systems. I touched a bit on
these in my InfixOWL write-up and presentation, but haven't really put
the whole picture together.
>

-- Chimezie

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: Ngozi Isabella (Chioma) Ogbuji

2009-07-20T20:00:07+00:00

Initial 'portrait' shot of the new baby!

Ngozi(chukwu.nyere) means the blessing that God (or heaven/celestial, by my interpretation) gave. My name (Chimezie) is an Igbo invokation for "(May) God resolve". My interpretation substitutes the 'abstract' notion of the celestial for the word God. My name was an invokation by my father to resolve things and after everything that has transpired, Ngozi is the gift or blessing that may bring about this resolution. My dad prefers to call her Chioma. It means 'good god.' Again, substituting the idea of the celetrial (as a stark contrast to phenomena of the 'terrestrial' ) for the Islamic/Judeo-Christian notion of God/god, you have the idea of a benevolent circumstance or fate.

Kwenu.com has a nice volume of decent translations of Igbo names. In fact, it also has a nice overview of the concept of "Chi" in Igbo mythology. Ironically, this concept as a strong correlation with my understanding of how the celestial interacts with the terrestrial, the rule of natural law, and how it relates to myself and humans in general. The chinese word "Chi" has similar connotation:

the life-process or “flow” of energy that sustains living beings are found in many belief systems, especially in Asia.

Igbo mythology and ancient Indo-Chinese spiritual philosophy have much in common, so I guess in the end it is not so odd that I have come to find myself practicing Indo-Chinese spiritual philosophy as a way to understand the crazy world that I live in. Their themes appeal to me in the same long-lasting way that the meanings invoked by the names of my children appeal to me.

I have a flickr album set of our (Roschella and I) favorite pictures of her

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: Using URIs to denote non information artifacts was - Re: Review of new HTTPbis text for 303 See Other from Jonathan Rees on 2009-07-07 (www-tag@w3.org from July 2009)

2009-07-20T19:00:05+00:00

Okay I finally get the idea of using de-referencable identifiers for non-information artifact 'entities'

Bookmark this on Delicious - Saved by chimezie to http tag www web - More about this bookmark

Uche and Chimezie Ogbuji: IBM Press room - 2009-06-30 IBM Research and European Union Provide Software Developers with Performance Gains and Faster Time-To-Market - United States

2009-07-20T19:00:05+00:00

"..the world's first open source machine learning compiler. The compiler intelligently optimizes applications, translating directly into shorter software development times and bigger performance gains."

Bookmark this on Delicious - Saved by chimezie to compiler programming learning machine-learning - More about this bookmark

Uche and Chimezie Ogbuji: Recent scenes from the ISS - The Big Picture - Boston.com

2009-07-20T19:00:05+00:00

"..Collected here are a handful of photographs of Sarychev Peak Volcano, and more, taken by astronauts aboard the ISS over the past few months."

Bookmark this on Delicious - Saved by chimezie to photo science earth geography - More about this bookmark

Uche and Chimezie Ogbuji: Chapter 18: Authentication and Authorization — Pylons Book v1.0 documentation

2009-07-20T19:00:05+00:00

AuthKit documentation

Bookmark this on Delicious - Saved by chimezie to python web authentication security api - More about this bookmark

Uche and Chimezie Ogbuji: Tongue of Warcraft, Part One—Taboo Words

2009-07-20T19:00:05+00:00

BOULDER, CO- I’ve studied martial arts most of my life, but I don’t enjoy watching fistfights. Sure, I sometimes watch MMA bouts, mostly as an exercise in making sense of techniques I learned in my Jujutsu days. But I am a salacious voyeur of one class of fights, one that weighs more in murderous intent than [...]

Uche and Chimezie Ogbuji: Proust, ooky cable guys, and everything in between

2009-07-20T19:00:05+00:00

via youtube.com

Hilarious story, "The Cable Guy Took a Dump in My Bathroom, Or, Why I Hate My Parents." by a friend and fellow writer on thenervousbreakdown.com. Kimberly is also an amateur filmmaker, and if you like her story, check out her film, "Why we wax".

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: Learn Chinese Characters

2009-07-20T19:00:05+00:00

Chinese characters and text

Bookmark this on Delicious - Saved by chimezie to language linguistics chinese writing culture typography - More about this bookmark

Uche and Chimezie Ogbuji: Recipe 576795: Partitioning a sequence

2009-07-20T19:00:05+00:00

Distinct partitions of a sequence.

Bookmark this on Delicious - Saved by chimezie to recipe python code datastructures - More about this bookmark

Uche and Chimezie Ogbuji: Knowledge Representation

2009-07-20T02:52:39+00:00

"[...] Knowledge Representation [...] Its mission is to make knowledge as explicit as possible. This is necessary because knowledge is stored in implicit form, i.e. tacit knowledge non-observable from the outside, inside minds and spread around in community social habits. "

Bookmark this on Delicious - Saved by chimezie to knowledge-representation knowledge logic reference - More about this bookmark

Uche and Chimezie Ogbuji: Tongue of Warcraft, Part Two—Politics of Language

2009-07-19T02:21:06+00:00

BOULDER, CO- It’s common among the literati to carry around a bunch of grammar gurus, like¹ Erykah Badu’s Bag Lady. Usually you’ll find some mix of H. G. Fowler, E. B. White and Quiller-Couch, and perhaps some volume-by-committee such as The Chicago Manual of Style or Hart’s Rules. I personally used to follow Fowler. I would [...]

Uche and Chimezie Ogbuji: The Tongue (my take)

2009-07-18T17:30:00+00:00

I wrote a little while back about how I found Karl Shapiro's "The Tongue" a rather flaccid piece (I reproduced it in that posting). It immediately set me to thinking how I might write about cunnilingus in that approximate style. It fell upon me to give it a go today. With Shapiro's anapests in my head I couldn't help the occasional echo, but for the most part I kept it to iamb and trochee, which feel to me a better fit for the luxury of the act.
>

The Tongue
>

As the head dropping on chocolate of tape—
Magnetic terrain of rhythm and rut—
Pinch roller fingers knead eager approach
Swelling to music is progress to what.

My tongue to the who in the arc of your voice,
To the hand caressing and guiding my ear,
Loops left wet behind my ascent
Anticipate pearly syrup of where.

Song and its ceasure, vox humana,
Thigh, tongue, hand in tumescent blend
As the mouth creeps upon the open petals
Nectar and fragrance annihilate when.

—Uche
18 July 2009
Superior

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: Detexify LaTeX handwritten symbol recognition

2009-07-17T21:43:46+00:00

"Anyone who works with LaTeX knows how time-consuming it can be to find a symbol in symbols-a4.pdf that you just can't memorize. Detexify is an attempt to simplify this search."

Bookmark this on Delicious - Saved by chimezie to mathematics tex latex math symbol tools drawing tool - More about this bookmark

Robert Brewer: The Ronacher Manifesto

fumanchu — 2009-07-15T01:10:47+00:00

http://lucumr.pocoo.org/2009/7/14/free-vs-free

I heartily agree with the bold bits at least:

So dear users: Use my stuff, have fun with it. And letting me know that you're doing is the best reward I can think of. And if you can contribute patches, that's even better.

Original post blogged on b2evolution.

Kevin Dangoor: MichiPUG July meeting tonight! Python in vfx, Impressive, 3.1

Kevin Dangoor — 2009-07-02T15:11:40+00:00

The next MichiPUG meeting will be on Thursday, July 2nd at 7PM. Ryan Burns will talk about the Impressive presentation software (which was used at Tuesday’s Ignite Ann Arbor) and Terry Howald will talk about Python’s use in scripting visual effects.We may also talk about the Python 3.1 release.

The meeting will be in downtown Ann Arbor at the SRT Solutions office.

Uche and Chimezie Ogbuji: Diamonds are so over

2009-06-08T01:00:29+00:00

I was listening to my beloved Asa today (Up Nigerian soul!) "Fire on the Mountain", an incredible monument of a song:

So you say you have a lover and you love her like no other
So you buy her a diamond that someone has died on
Don't you think there's something wrong with this?

Diamonds are contemptible bits of mediocre mineral that serve testimony to the gullibility and pliability of the public. I can't wait for the advent of perfect, carats-for-pennies diamonds from the laboratory, and it won't be long (would probably have been by now if not for the invidiousness of the diamond cartels). Soon, I hope, we can finally ditch the foetid illusion that diamonds have any value.

Hey Mr. soldier man, tomorrow is the day you go to war
Boy you are fighting for another man's cause and you don't even know him
>

Ooooh!
>

What did they say to make you so blind to your conscience and reason?
Could it be love for your country or for the gun you use in killing?

Or for the diamonds that corrupt your country and purchase those very guns?
>

You've heard it before, but Asa tells it with a fierce trueness. It's time to stop giving money to the diamond cartels. You might as well spend two months' salary funding coca and poppy production.

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: The Tongue

2009-06-08T01:00:29+00:00

In my poetical wandering over the weekend I ran across Karl Shapiro's "The Tongue". He starts by getting the conceit all wrong, and even though it bears the execution of a fine craft piece, the result comes off a bit of a mess.
>

As a slug on the flat of the sun-heated clay, With the spit of its track left behind it like glass, Imperceptibly voyages, licking its way In the sinuous slime of itself to the grass, So my tongue on the white-heated wall of your thigh Licks its belly across, and the path of my slime Lies in ribbons of passion, the wet and the dry Overlapping to mount to the leaf of its climb. And the mouth and the mouth and the tongue and the tongue And the fishes that feed in the joy of our oil And the slug of our wetness finds green food among The hair-forests of longing where serpents uncoil.
>

You can see how the cleverness dampens the sense, something I often struggle with myself. This is a large part of the reason why Shapiro, despite his technical skill, has never been as celebrated as he should be. He tries to use a sprinkling of words ("passion", "longing") to mend the detachment of the conceit of the slug, which could never hope to transport the idea of a tongue inching towards cunnilingus.
>

The piece pretty much cries out for a rival metaphysical poet's response. And it should serve as a lesson to me.

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: Automatic Generation of Computer Animation: Using AI for Movie Animation

2009-06-08T01:00:29+00:00

Turning a story in text form into an animated movie is a long and complicated procedure. [...] many parts of this process could be automated by using artificial intelligence techniques [...] So we decided to explore the possibility of a generation process of computer animation from a childrens story in natural language text form to the final animated movie.

Bookmark this on Delicious - Saved by chimezie to ai theory logic literature semantic - More about this bookmark

Uche and Chimezie Ogbuji: Data chef: SPSS Tripe Consommé

2009-06-08T01:00:29+00:00

The data chef discusses translation of data from SPSS format, for those who don't have a licensed copy at hand.

Uche and Chimezie Ogbuji: Only one poem for the implosion of Capital

2009-06-08T01:00:29+00:00

BOULDER, CO- I’ve often heard it said that “there is no such thing as a communist Igbo”, a reference to our intense mercantile culture. Somewhat like stereotype of Lebanese, we’ve tended to structure our very existence around what we can sell, and in this 419 age, what we can con out of others. Ok, [...]

Uche and Chimezie Ogbuji: NLTK Home ‎(Natural Language Toolkit)‎

2009-06-08T01:00:29+00:00

Open source Python modules, linguistic data and documentation for research and development in natural language processing, supporting dozens of NLP tasks

Bookmark this on Delicious - Saved by chimezie to python nlp code programming linguistics - More about this bookmark

Uche and Chimezie Ogbuji: Stephen Marsland

2009-06-08T01:00:29+00:00

"I've written a textbook entitled 'Machine Learning: An Algorithmic Perspective'. [...] There are lots of Python code examples in the book, and the code is available here." Yummy

Bookmark this on Delicious - Saved by chimezie to code python machine-learning programming - More about this bookmark

Uche and Chimezie Ogbuji: Character-length restrictions, RPC, and choosing FriendFeed over Twitter

2009-06-08T01:00:29+00:00

Database field-length silliness has haunted me throughout my career as an data/information architect, and

Uche and Chimezie Ogbuji: Semantic Web takes root at the IA Summit « Meaningful Data

2009-06-08T01:00:29+00:00

Semantic Web takes root at the IA Summit « Meaningful Data

Bookmark added by Uche Ogbuji at 09:44 PM CDT

"At the recent IA Summit, I was surprised and delighted to see how many talks there were about the

Uche and Chimezie Ogbuji: On Model Theory

2009-06-08T01:00:29+00:00

So, I've started a part-time Ph.D program at the EECS department of
Case Western University. I'm hoping to write a thesis on higher
education information science as patient advocacy. I've taken a
course on Machine Learning, database systems, and now on model theory.
Luckily Case has a class on model theory in the philosophy
department. But it also counts as credit from the graduate
mathematics department.
>

The class on model theory is about Kurt Godel's (I know I'm
misspelling it) theory on the incompleteness theory of peano's
arithmetic ( an axiomatization of number theory ). The book for the
class, It is supposed to be written by mathematical geniuses, our
professor proclaims. The book is ".."
>

Models are states of absolute (binary) logical certainty: things that
are or things that aren't. Statements in this language are 'sound'
(they follow from our understanding of logic). The consist of
domains: sets of 'things' denoted by terms in a written language (a
first-order language). The model also consists of 'interpretations'
of phrases (or formulas) in this language, some of which are 'closed'
(i.e., all variables refer to constants interpreted through this
model) or open. The axiomatic nature of basic science presumes
logical certainty in its canon. The language consists of constants
that can be interpreted 'against' the domain of a model, sets of
constants composed form constants interpreted against the domain of
the model, functions that map sets of members of the domain to members
of the domain, 'relations' over the domains, and a determination of
'equality' over members of the domain. Model theory is the basis of
first-order theory, logic-based knowledge representation, numeric
theory, etc..
>

Godel's theory says that any axiomatic system that is as expressive as
some computable representation of number theory is not complete (i.e.,
there is at least one question you can formulate in the language for
which you cannot say with certainty that it is so or it isn't so).
>

Models 'entail' sets of formulas when they entail all the members of
the set. Models satisfy sentences and 'terms' in languages. Some
formulas can be said to be valid in every model (i.e., they are
satisfied by every model of a language) or they specifically are
entailed by a particular model. Axiomatic machinations (finite state
automata, etc..) are systems about languages and a set of axioms that
can be used to 'derive' expressions in the language via a finite set
of valid theories, specifically given sentences in a theory, or
sentences that follow from modus ponens (common sense if / then
conditionals) and sentences in a theory (a scientific theory).
>

As our prof puts it, all of logic programming (and database theory) is
spawned by this known limitation to model theory and first-order
logic. They are restricted forms of it that are complete (unlike
number theoretic languages), and sound and thus 'decidable' by a
finite state automaton or turing machine.
>

Systems that describe their 'formal semantics' - the meaning of
statements made in their languages often describe them using model
theory (all of semantic web theory does this: RDF, RDFS, OWL-DL,
etc..). More on this later

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: Using OWL and Default Negation to Reason about Patient Records

2009-06-08T01:00:29+00:00

We've been using SPARQL, OWL, and N3 lately to prototype the reporting
of common research variables to the Society of Thoracic Surgeon's
(STS) National Database. The reports are being run against our large
RDF dataset of abstracted electronic patient records from the
Cleveland Clinic's Electronic Health Record system. Our dataset
consists of about 200,000 patients each represented as statements in
named RDF graphs. The STS variables we are responsible for deriving
are represented using a combination of OWL-DL and Notation 3. The
constraints that do not benefit from the restricted, tree-like nature of description logic are captured using secondary plain Horn clauses
(or rules) represented in Notation 3.
>

We use an open source logic reasoning system for the semantic web that
converts the constraints and a SPARQL query for an RDF dataset
governed by these OWL-DL constraints into provably optimal sets of
rules used to calculate an entailed RDF graph (the specifics of this
method is a subject of a paper I'm working on for the RuleML 2009
conference). Such an entailed RDF graph can then be targeted with
SPARQL queries to answer for the STS variables. A recent challenge
has been to try to capture the semantics of negation in order to
implement 'exclusion criteria'. This is typically of the form of a
class of procedures that do not involve combinations of one or more
kinds of other procedures. A recent update to FuXi includes the
ability to convert OWL-DL expressions that use owl:complementOf into
general, stratified, logic programs that can be evaluated using SPARQL
in order to implement the semantics of stable model negation (which is
quite different from the way owl:complementOf is meant to be
interpreted: according to the negation of first-order logic).
>

In particular, statements of classical (first-order) negation are
making assertions about the lack of existence of models that satisfy
the positive form of such a statement in a theory. I prefer this
explanation to the way the term 'open world' assumption is often
used to describe this interpretation of negated terms in a
description logic language. Database theory, ofcourse, does not interpret negated terms
in this way, but instead (intuitively) understands statements of negated terms to be
'true' if the (ground) positive form is not in the set of known facts (the
database).

Our use of negation, and the nature of knowledge
recorded in a computer-based patient record system seems (so far) to
lend itself more to the database interpretation where there is an
understanding that a curated medical information system would have its
data entered under the governance of policies that would allow
medically useful inferences to be made from the absence of certain
facts about patient care.
>

In particular, if a fact is known to not be true about a patient or
some activity involving a patient, it is not recorded. This common
understanding can be used to make inferences about whether facts in a
patient record satisfy an exclusion criteria. Below is an example of
this:
>

Consider the following OWL descriptions of a class of operations:

SubClassOf(
IntersectionOf(
Operation
PostOpInHOspitalEvent
ObjectAllValuesFrom(
involves
ComplementOf( UnionOf( CardiacProcedure ThoracicControlBleeding ) ) )
)
sts:ReopForOtherNonCardiac )

The syntax above is the OWL2 functional-style syntax. We can
paraphrase the general class inclusion (GCI) axiom above as saying:
".. all operations that followed another operation and do not involve any
cardiac procedures or thoracic control bleeding procedures."
"
The original documentation for this variable in the STS adult cardiac
database manual says:

Indicate whether the patient returned to the operating room for
other non-cardiac reasons

Now, if we assume that all operations of interest and the involved
procedures are explicitly recorded in our patient RDF dataset. This
general class inclusion axioms can be reduced into a set of rules that use negated
'literals' (as they are called); understood to capture the semantics of
default negation (or the 'closed world assumption'). It is worth noting that this is exemplary of a class of expressions that description logic, tableaux-based reasoning algorithms often have problems with.

Conjunctive query answering for stratified datalog is a well-studied class of
problems in database theory. It is through the insight of this canon of theory that FuXi is now able to reduce
OWL-DL expressions that use owl:complementOf into sets of rules (or
logic programs) that can be efficiently processed in order to
implement SPARQL entailment regimes for combinations of OWL and
rule-based representations for the semantic web such as
Notation 3 or RIF core.
>

The current FuXi implementation converts the GCI into the following
two RIF rules:

Forall ?X ?QrjeKHuq961 (
?X # sts:ReopForOtherNonCardiac

:- And(

    ?X # PostOpInHospitalEvent
    ?X # Operation,
    Naf ?X[involves -> ?QrjeKHuq961] ) )

Forall ?X ?QrjeKHuq961 (
?X # sts:ReopForOtherNonCardiac
:- And(

    ?X # PostOpInHospitalEvent ,
    ?X # Operation,
    ?X[involves -> ?QrjeKHuq961],
    Naf ?QrjeKHuq961 # CardiacProcedure,
    Naf ?QrjeKHuq961 # ThoracicControlBleeding ) )

Note, Naf is in the (current) 30 July 2008 version of the "RIF
Framework for Logic Dialects"

The first rule describes members of the clas of ReopForOtherNonCardiac as those post-operative operations (i.e., operations that follow another operation in the same patient hospital visit or episode) that do not involve other procedures.

The second rule applies to those post-operative operations that do involve other procedures where these other operations are not either cardiac procedures or thoracic control bleeding procedures.

These RIF rules can be exchanged with other RIF-compliant rule-based
systems that implement any of the well-accepted semantics for negated
formulas in horn clause logic (stable models, well-founded models,
stratified models, etc.). A recent modification to FuXi makes
use of a programmatic SPARQL interface for Python that a colleague of
mind has been working on called telescope. It works with
rdflib (same as FuXi) and is used as a control layer that converts
negated RIF rules into a series of SPARQL queries involving
OPTIONAL/FILTER/!BOUND that are used to calculate "stratified models"
(i.e., the finite set of facts that can be inferred from the set of
rules that include negated literals).
>

Renzo Angles et al. (2008) and Polleres, A. (2007) have since
demonstrated that the expressive power of SPARQL coincides with that
of datalog with negation, so it comes as no suprise that certain
datalog clauses (or rules) can be converted into SPARQL queries using
so-called copy-patterns and the introduction of a MINUS operator. For
the details of how this operator works and how its semantics are
equivalent with that of datalog, the reader is urged to read any of
the above mentioned papers.
>

telescope is used to programatically convert MINUS operators into a
SPARQL queries that answer for RIF rules with the corresponding
negated frame formulas below:

SELECT ?X
WHERE {
?X a PostOpInHospitalEvent .
?X a Operation
#The post-operative operation does not invlolve any procedures
OPTIONAL { ?X involves ?QrjeKHuq961 }
FILTER (!bound(?QrjeKHuq961))
}

SELECT ?X
WHERE {
?X a PostOpInHospitalEvent .
?X a Operation .
?X involves ?QrjeKHuq961
#In the case where the post-operative operation involves a procedure
it is *not* either a
# cardiac procedure or a thoracic control bleeding
OPTIONAL {
?QrjeKHuq961 a CardiacProcedure .
?QrjeKHuq961 a ThoracicControlBleeding .
?QrjeKHuq16542 a CardiacProcedure .
?QrjeKHuq16542 a ThoracicControlBleeding
FILTER (?QrjeKHuq961 = ?QrjeKHuq16542)
}
FILTER (!bound(?QrjeKHuq16542))
}

I'll be adding a wiki shortly (on the python-dlp google code wiki)
describing the explicit APIs that can be used for this purpose, but I
wanted to give the feature some context in the recent work I've been
doing on applications of semantic web for medical informatics
>

-- Chimezie

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: RDF / OWL Tool Developers Should Respect xml:base!

2009-06-08T01:00:29+00:00

Okay. I think it needs to be said that RDF / OWL tool-makers do not
do a good job of respecting the mechanics of xml:base . It seems
almost a given that most of them mangle the URI base resolution
conventions they find in existing RDF/OWL files, overwriting them with
their own. Often, this happens in a very destructive way that can be
even more annoying for a person who has much experience using XML and
thus has a better appreciation (perhaps) of the value of a base URI of
an OWL document for more than just owl:Ontology/@rdf:about.
>

This is the typical scenario: I create an OWL document like so:
>

<rdf:RDF>
<owl:Ontology rdf:about="">
<owl:imports rdf:resource=".. relative path .."/>
> <owl:Ontology>
</owl:Ontology>
<owl:Class rdf:about="tag:info@example.com#Stuff"/>
"/>
</rdf:RDF>
>

First, let me describe the intent here. I think it is perfectly
reasonable to modularize large ontologies into fragments (if you will)
that are bundled together and linked via relative imports. Since they
are bundled together, I often like to use the power of URI resolution
to make relative references to imported OWL documents (as you can see
above) in a way that is completely independent from where the bundle
is being deployed (file system or on the web).
>

The downside of not using xml:base explicitly is that the URIs of my
classes need to be fully qualified, but as far as I'm concerned this
is outweighed by the advantage of knowing that I can deploy my bundled
import network on a website or on a filesystem and have any
self-respecting tool know how to resolve the relative URIs.
>

One of the more involved technical points during the development of
GRDDL was regarding the use of empty URI references in GRDDL results.
The primary importance of empty, relative URI references (in RDF serializations) is the
ability to refer to the containing document without necessarily having
the URI on hand. It was this particular dialogue that made me better
appreciate the power and simplicity of the URI base resolution process
that sits at the bottom of many of the important W3C specifications.
>

From RFC 3986 (the process of determining the Base URI to use when
resolving relative URIs):
>

* The base URI is embedded in the document's content.
* The base URI is that of the encapsulating entity (message, document, or none).
* The base URI is the URI used to retrieve the entity.
* The base URI is defined by the context of the application.
>

Getting back to my example above (this was supposed to be a short
rant). Too often what happens is that when I load an OWL document
such as the oneabove into an OWL editor and save it (even after not
making any changes), it results in:
>

<rdf:RDF xml:base="tag:info@example.com#">
">
<owl:Ontology rdf:about="">
<owl:imports rdf:resource="file:///path/to/OWL/document"/>
> <owl:Ontology>
</owl:Ontology>
<owl:Class rdf:ID="Stuff"/>
</rdf:RDF>

<insert appropriate expletive>
>

Now, it's not so much the 'forced' use of rdf:ID that bothers me as
the fact that the relative paths used for the imports are now replaced
with absolute URIs. This sabotages the advantage I once had of being
able to rely on the URI resolution chain to be sufficient for clients
that need to resolve my relative URIs. Essentially, the OWL tool has
monopolized the opportunity to resolve relative URI references.
>

Now, in fairness, it seems much of the motivation of doing this is to
associate an explicit base URI with the ontology itself and often
ontology tools will complain if they are unable to determine an
absolute URI to use for this purpose. I think a better mechanism for
doing this would be explicit attributes or elements rather than
bastardization of the ability to give an explicit URI base in content.
>

It seems to me that if the author wanted to associate an explicit URI
with the ontology he or she would use one in the place of an empty,
relative URI reference. In fact, I would go as far as saying that it
is bad practice to forcibly insert an @xml:base in a document that
doesn't have one *and* uses empty, relative reference!
>

So, for any developers of RDF / OWL tools, please take care in trying
not to enforce a base resolution scheme despite the document author
providing one of their own for reasons that are orthogonal to
associating a URI to an ontology (and more important as far I'm
concerned): deployability.

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: This is how I feel everytime I see a double parked car

2009-06-08T01:00:29+00:00

Parking

via xkcd.com on 3/29/09

Permalink | Leave a comment »

Uche and Chimezie Ogbuji: "The Thinking Man’s Rapper", Black Thought interviewed by Touré [The Daily Beast]

2009-06-08T01:00:29+00:00

"The Thinking Man’s Rapper", Black Thought interviewed by Touré [The Daily Beast]

Bookmark added by Uche Ogbuji at 11:51 AM CDT

The Thinking Man’s Rapper In a rare interview, Touré talks with Black Thought—front man for The Roots and the new house MC of Late Night with Jimmy Fallon —

Uche and Chimezie Ogbuji: RBMA Radio: Fireside Chat - The Roots

2009-06-08T01:00:29+00:00

RBMA Radio: Fireside Chat - The Roots

Bookmark added by Uche Ogbuji at 08:09 AM CDT

Long interview with Roots, interspersing their music, giving an overview of their history and work.

Uche and Chimezie Ogbuji: New World (tap) Water [Poster Boy @ Flickr]

2009-06-08T01:00:29+00:00

New World (tap) Water [Poster Boy @ Flickr]

Image added by Uche Ogbuji at 01:21 PM CST

Neat homage by the brilliant and infamous "Poster Boy" to one of the great songs of Hip-Hop.

Uche and Chimezie Ogbuji: Your Website is Your API: Quick Wins for Government Data [Jeni Tennison]

2009-06-08T01:00:29+00:00

Your Website is Your API: Quick Wins for Government Data [Jeni Tennison]

Comment added by Uche Ogbuji at 12:33 PM CST

Great distillation of common sense.

Uche and Chimezie Ogbuji: Cobe Obeah "Know Thyself" [okayplayer - Audio]

2009-06-08T01:00:29+00:00

Cobe Obeah "Know Thyself" [okayplayer - Audio]

Comment added by Uche Ogbuji at 11:45 PM CST

Cobe Obeah comes with some of the illest lyrics I've heard in a minute (and I keep my ears out there). Minimalist production, but sometimes that's a good thing when someone is

Kevin Dangoor: MichiPUG: using Python to run reports in Hadoop clusters

Kevin Dangoor — 2009-06-02T20:01:58+00:00

Zattoo’s Marshall Weir will be talking at this week’s MichiPUG (Thursday evening at 7PM at SRT Solutions in downtown Ann Arbor). In his own words:

I’ve been working on a python module for running reports in Hadoop. Its sort of a wrapper around the pig data processing language and some smarts for running reports on a hadoop cluster and pushing and pulling data to it. It’s designed primarily to make it easier and more efficient to run complex sets of interdependent reports – I’ve been using it to do business reporting on our customer behavior at Zattoo.

This should be very interesting for folks like me who have never seen Hadoop in action!

Robert Brewer: Best of PyCon 2009

fumanchu — 2009-05-05T15:00:00+00:00

Toshio Kuratomi's How to Build Applications Linux Distributions will Package. As a web framework dev, this was priceless.

Original post blogged on b2evolution.

Kevin Dangoor: MichiPUG May meeting: non-relational DBs

Kevin Dangoor — 2009-05-05T11:23:41+00:00

The next MichiPUG meeting will be on Thursday, May 7th at 7PM. The topic for this week is newfangled non-relational databases (with demos of Couch DB, Mongo DB, Tokyo Cabinet, Persevere, and Redis promised)

via Welcome – Michigan Python Users Group | Google Groups.

As usual, the meeting will be at the SRT Solutions office in downtown Ann Arbor.

Robert Brewer: PyCon Presentations

fumanchu — 2009-03-27T00:03:31+00:00

For PyCon 2009, I'm giving two talks! One on extending CherryPy and one on the innards of Dejavu/GeniuSQL. I think I've finally reduced my talks to the required time slots (I could easily have made 4-hour talks for each and posted my presentations:

Use the arrow keys or mouse-click to proceed through them. The images don't load as fast over the network as they will when I present, so be patient if you preview them yourself. Also, try to use 1024 x 768 fullscreen--they're laid out specifically for that resolution.

Update: video is now available thanks to the great people who put on PyCon:

CherryPy: http://blip.tv/file/1957163/
Dejavu: http://blip.tv/file/1949237/

Original post blogged on b2evolution.

Uche and Chimezie Ogbuji: Slender Mitochondrial Strand

2009-03-25T16:00:33+00:00

BOULDER, CO- Mitochondrial DNA is a profound, primeval truth. As far back as all the creatures we can see with our naked eye, ourselves included, it’s meant that the blueprints for the energy of our lives are passed only through the lines of mothers. Poetry is all about such profound truths. Sometimes those truths possess lives [...]

Uche and Chimezie Ogbuji: Maps: Migration Flows in the United States

2009-03-25T16:00:33+00:00

Bookmark this on Delicious - Saved by chimezie to visualization demographics population map - More about this bookmark

Uche and Chimezie Ogbuji: Total ordering class decorator « ActiveState Code

2009-03-25T16:00:33+00:00

Given a class defining one or more ordering methods, this decorator supplies the rest. This simplifies and speeds-up the approach taken in recipe 576529.

Bookmark this on Delicious - Saved by chimezie to recipe python code comparison - More about this bookmark

Uche and Chimezie Ogbuji: A RESTful wrapper for MoinMoin

2009-03-25T16:00:33+00:00

I've always loved the MoinMoin wiki, and lately I've been using it for more and more, at work and at home. I've pined for a REST wrapper for a while, and I finally bit the bullet and wrote one, as part of the open-source Akara project, which among other things provides RESTful access to the

Uche and Chimezie Ogbuji: A Unix Utility You Should Know About: Pipe Viewer

2009-03-25T16:00:33+00:00

"Pipe viewer is a terminal-based tool for monitoring the progress of data through a pipeline. It can be inserted into any normal pipeline between two processes to give a visual indication of how quickly data is passing through, how long it has taken, how near to completion it is, and an estimate of how long it will be until completion."

Bookmark this on Delicious - Saved by chimezie to article tool unix console - More about this bookmark

Kevin Dangoor: Paver 1.0 released!

Kevin Dangoor — 2009-03-23T13:10:23+00:00

At long last, I’ve released Paver 1.0. Here’s the announcement that I sent to python-announce:

After months of use in production and about two months of public testing for 1.0, Paver 1.0 has been released. The changes between Paver 0.8.1, the most recent stable release, and 1.0 are quite significant. Paver 1.0 is easier, cleaner, less magical and just better all around. The backwards compatibility breaks should be easy enough to work around, are described in DeprecationWarnings and were introduced in 1.0a1 back in January.

Paver’s home page: http://www.blueskyonmars.com/projects/paver/

What is Paver?

Paver is a Python-based software project scripting tool along the lines of Make or Rake. It is not designed to handle the dependency tracking requirements of, for example, a C program. It *is* designed to help out with all of your other repetitive tasks (run documentation
generators, moving files about, downloading things), all with the convenience of Python’s syntax and massive library of code.

If you’re developing applications in Python, you get even more… Most public Python projects use distutils or setuptools to create source tarballs for distribution. (Private projects can take advantage of this, too!) Have you ever wanted to generate the docs before building the source distribution? With Paver, you can, trivially. Here’s a complete pavement.py::

    from paver.easy import *
    from paver.setuputils import setup
 
    setup(
        name="MyCoolProject",
        packages=['mycool'],
        version="1.0",
        url="http://www.blueskyonmars.com/",
        author="Kevin Dangoor",
        author_email="dangoor@gmail.com"
    )
 
    @task
    @needs(['html', "distutils.command.sdist"])
    def sdist():
        """Generate docs and source distribution."""
        pass

With that pavement file, you can just run “paver sdist“, and your docs will be rebuilt automatically before creating the source distribution. It’s also easy to move the generated docs into some other directory (and, of course, you can tell Paver where your docs are stored, if they’re not in the default location.)

Installation

The easiest way to get Paver is if you have setuptools_ installed.

easy_install Paver

Without setuptools, it’s still pretty easy. Download the Paver .tgz file from Paver’s Cheeseshop page, untar it and run:

python setup.py install

Help and Development

You can get help from the mailing list.

If you’d like to help out with Paver, you can check the code out from Googlecode:

svn checkout http://paver.googlecode.com/svn/trunk/ paver-read-only

You can also take a look at Paver’s project page on Googlecode.

Kevin Dangoor: Paver 1.0b1 released

Kevin Dangoor — 2009-03-13T13:15:47+00:00

I’ve just released Paver 1.0b1. This new release adds a fun little feature. A typical setup.py script looks like this:

from distutils.core import setup
 
setup(name="Foo", ...)

With the new version of Paver, you can now rename setup.py to pavement.py (or run paver -f setup.py) and then do:

from paver.setuputils import setup
 
setup(name="Foo", ...)

That gets you going quite quickly, doesn’t it? Of course, you’d likely want to add from paver.easy import * and to start making tasks that take advantage of Paver.

1.0b1 includes some other bug fixes, brings back the call_task function (particularly useful for distutils tasks), and makes the help output more consistent.

There’s one more bug on my list to fix (the distutils output is not showing up), and then I need to rework the docs for Paver 1.0.

Update: It occurred to me a bit later that my example above doesn’t work, because you need to call install_distutils_tasks to get Paver to pick up all of the distutils/setuptools commands. However, this will be fixed in rc1.

Kevin Dangoor: Paver 1.0a3 released

Kevin Dangoor — 2009-03-06T16:14:26+00:00

I have just released Paver 1.0a3. This has some good refinements on the way to 1.0 final and a couple of nice, new features (the “auto” task and the “pushd” context manager):

Added automatic running of “auto” task. If there’s a task with the name “auto”, it is run automatically. Using this mechanism, you can write code that sets up the options any way you wish, and without using globals at all (because the auto task can be given options as a parameter).
When generating egg_info running “paver”, the full path to the Paver script was getting included in egg-info/SOURCES.txt. This causes installation problems on Windows, at the very least. Paver will now instead place the pavement that is being run in there. This likely has the beneficial side effect of not requiring a MANIFEST.in file just to include the pavement.
the options help provided via the cmdopts decorator now appears
pavements can now refer to __file__ to get their own filename. You can also just declare pavement_file as an argument to your task function, if you wish.
call_pavement now switches directories to the location of the pavement and then switches back when returning
if you try to run a function as a task, you’ll now get a more appropriate and descriptive BuildFailure, rather than an AttributeError
paver can now again run tasks even when there is no pavement present. any task accessible via paver.easy (which now also includes misctasks) will work.

added the pushd context manager (Python 2.5+). This will switch into another directory on the way in and then change back to the old directory on the way out. Suggested by Steve Howe, with the additional suggestion from Juergen Hermann to return the old directory:

<span class="k">with</span> <span class="n">pushd</span><span class="p">(</span><span class="s">'newdirectory'</span><span class="p">)</span> <span class="k">as</span> <span class="n">olddirectory</span><span class="p">:</span><br />    <span class="o">...</span><span class="n">do</span> <span class="n">something</span><span class="o">...</span><br /><br />

Kevin Dangoor: MichiPUG meeting tomorrow, March 5th

Kevin Dangoor — 2009-03-04T12:44:07+00:00

The monthly Michigan Python Users Group (MichiPUG) meeting is coming up tomorrow! This month, we’re going to do something a little different: sprinting on a project to help out a new coworking space that is being set up in downtown Ann Arbor (see below for the full description from Bob Kuehne).

As usual, the meeting starts at 7PM at SRT Solutions.

proposal for 03/02/09 – Michigan Python Users Group | Google Groups

background:

* a guy named mike kessler is opening a co-working space on main
street, tween washington and huron, in the
old arcadian too space, right next door to (south) vinology. the
space is designed as a place where people
can pop in for a day, hang out, work with other people, get a
permanent desk, host trainings, etc. it’s
going to be pretty cool.

* as part of that, he needed some sort of door lock/authentication
system. i volunteered to put one
together, and it’s coming along fine, from the hardware and
software side. it’s basically a bag of
scripts (python, natch), and some csv files for manager users,
logging, whatever. oh, and a door latch
that gets controlled by the above.

* but from a ui perspective, i know better things could be done, and
this is where you come in.

pug topic/sprint:

* if people are up for it, i’d like to do three things:
* 30m : setup tasks, review / design schema
* 60m : split into groups and build an interactive site to do a few
tasks
* 30m : each group discuss results, demonstrate (10-15m@)

Kevin Dangoor: Embarrassment Driven Development

Kevin Dangoor — 2009-03-02T14:03:09+00:00

Googling “embarrassment driven development” (EDD) does not return as many hits as it should. I think it’s a very powerful development technique. I first heard the expression from the Plone guys at PyCon 2006, and Google did turn up this match:

[ArchipelagoSprint] Time to get cracking on Plone 3.0!

Wrt. timelines, I was hoping that we could try to have a “Tech preview” release before the Plone Conference 2006 in Seattle (October 25-27) – I’m going to be on-stage there talking about the exciting new features of Plone 3.0 – and I’d like to not be booed off stage. Yes, this is embarrassment-driven development – as usual.

That’s Alexander Limi illustrating the prime motivator for EDD.

The idea behind EDD is simple: if you have to demo something in front of an audience, and that something sucks, you will move hell or high water to make sure you don’t look like an idiot.

Every product has rough edges and warts, but no one wants a demo to be all warty and to have to say “yeah, I know you shouldn’t have to click to the left of the button, but we just haven’t gotten to that yet”. EDD ensures that, at least for the parts you have to get up and show, the rough edges will be smoothed in time for the show.

I’m going to be practicing EDD leading up to JSConf. I want to be able to show some useful, non-trivial bits of ServerJS work by then.

Kevin Dangoor: Paver 1.0a2 released!

Kevin Dangoor — 2009-02-26T15:23:34+00:00

I’m happy to announce that Paver 1.0a2 has been released! And, unlike Paver 1.0a1, it installs (thanks to Greg Thornton for the patch for that!). I’ve been quite busy with other projects over the past month, so I appreciate the help of Marc Sibson and Greg Thornton in making 1.0a2 a nice improvement over 1.0a1.

Paver 1.0 is still for the slightly adventurous, because it has not yet seen testing by many people. Paver is not complex code (and Paver 1.0 is, I think, less complex than Paver 0.8 was), so it’s not hard to dig in if you have a problem.

Assuming nothing major comes up, I expect Paver 1.0 final to be out by PyCon.

Speaking of PyCon, I won’t be attending PyCon this year as I have a lot of other things on my plate at work this time around. Mark Ramm will be doing the Paver talk in my stead, just as he did at PyOhio last year.

Christian Wyglendowski: Caching HTTP Responses with CherryPy

christian — 2009-02-25T14:53:00+00:00

The most basic case is very simple.

import time
import cherrypy
 
class WebSvc(object):
    @cherrypy.tools.caching(delay=300)
    @cherrypy.expose
    def quadruple(self, number):
        time.sleep(1) # make the real call somewhat costly
        return str(int(number) * 4)
 
cherrypy.quickstart(WebSvc())

That uses an in-memory cache and defaults to items expiring from the cache in 300 seconds (5 minutes). If you want to tweak that setting or others you can configure the caching tool to your liking.

This is in response to a post that asks if setting up caching in other web frameworks is as easy as in ~~Rails~~ Ruby with Sinatra.

Kevin Dangoor: Introduction to the Bespin Python backend

Kevin Dangoor — 2009-02-25T01:44:57+00:00

It’s been less than two weeks since Bespin was introduced, and there’s already been an impressive amount of activity around the open source project. There are at least 3 entirely new Bespin servers that I’m aware of.

The current Bespin server that we at Mozilla are maintaining is written in Python and appears in the backend/python directory in the Bespin source. To help people get up to speed with the code, I have created a screencast to help people get started with the Python backend and give them an idea of how the code is set up.

I look forward to hearing your feedback!

Bespin Python Backend Overview from Kevin Dangoor on Vimeo.

Kevin Dangoor: Creating a web framework with WSGI video

Kevin Dangoor — 2009-02-18T02:54:14+00:00

Creating a web framework with WSGI on Vimeo

The Michigan Python Users Group (MichiPUG) meeting topic from February 2009, presented by Kevin Dangoor. This screencast video shows us using WSGI components to build up a web framework piece-by-piece.

By the way, for people who are interested in working on the Bespin server, this is the kind of “web framework” that the server is built upon.

Kevin Dangoor: Bespin: code in the cloud

Kevin Dangoor — 2009-02-15T01:30:19+00:00

Despite working for an open source company, I have been pretty quiet here about what I’ve been doing in the Mozilla Labs web developer tools group. No more. We’ve gone public!

Mozilla Labs » Blog Archive » Introducing Bespin

Bespin proposes an open extensible web-based framework for code editing that aims to increase developer productivity, enable compelling user experiences, and promote the use of open standards.

I started working on Bespin as soon as I joined Mozilla, hitting the ground running with a new Python server. Ben and Dion had already done a lot of work and experimentation on Bespin prior to joining Mozilla in December, so I must confess that I am still fairly ignorant about the Canvas-based magic that they’re doing in the UI. But, Bespin has an architecture that lends itself well to selective ignorance: the server provides a RESTful API, and the client is responsible for all of the presentation. For their part, Ben and Dion have been able to be blissfully ignorant about the inner workings of the Python server.

Of course, I’m not a JavaScript noob and have done some work in the client, but my focus has been the server. Now that we’re out in the open, you can definitely expect that we’ll be talking more about how things work and how you can bend Bespin to your will. Bespin is honest to goodness open source (MPL-licensed), so it becomes an open and collaborative effort starting right away.

The initial reaction has been fantastic. There are tons of people hanging out in #bespin on irc.mozilla.org, and the mailing list has grown to a couple hundred members already. Thanks to everyone for jumping in with your thoughts and patches!

Here’s some of the coverage:

Dion’s post at Ajaxian:

From Dion’s personal blog:

Foolish chaps and companies have come to me in the past thinking that open source will be a silver bullet for “getting other people to do our work.” Those that have been involved in open source know that it isn’t the case. It is often more work. But, it is worth it.

From Ars Technica:

The project is still at an early stage of development and there is clearly a lot of work to be done before it will be able to deliver the same practical value as existing desktop editors. Despite the limitations, it shows an enormous amount of promise and has the potential to eventually deliver a user experience that rivals even the best text editors.

From Five Questions with Dion Almaer:

Now the browsers are moving fast again and building a first class platform for us to develop, the Open Web Platform. Instead of getting bogged down thinking about what IE 6 gives you, take some time to think about what you could build with the latest technology. I realise that you have to be pragmatic and get things working with your audience, but browsers are changing, and so are expectations.

From What Mozilla’s Bespin Bespeaks (ComputerworldUK):

You can see that Bespin is ticking all the Mozilla boxes, but what’s also striking is that this is a Web-based project: Mozilla is entering the cloud. It’s a further shift to viewing the Web as a platform for doing, well, just about anything. Clearly, against that background, open standards are even more important. And not only for the code: another issue that Mozilla will need to start addressing publicly is that of open data. As more stuff moves into the cloud, it become imperative to establish minimum standards for access to the data that is held there. I look forward to hearing Mozilla’s views on the subject.

While I certainly don’t speak for Mozilla, I would be extremely surprised if there’s anyone at Mozilla that believes that users should have anything less than full access and ability to take their data with them. There can be technical issues involved in providing the data, but the data should be available in some reasonable form. Bespin, for its part, makes it easy to export a project in a tarball or zipfile.

I was surprised to see Bespin covered even on Lifehacker:

Primarily, Bespin is a text editor—the kind you’d use for editing code or managing text-based todos. Using Bespin, developers could collaborate on projects through a unified interface (that still supports plugins!) no matter where they are—so long as they’ve got a browser.

cnet has the story, too:

For example, what about integration with open-source software repositories? If it’s flexible enough, Bespin could essentially act as a source code viewer that repositories such as SourceForge or Google Code could employ.

A nice writeup on the ReadWriteWeb as well:

It’s clear that a great deal of thought and attention went into this early version - and it’s a safe bet that it will only get more impressive as time goes on.

RWW last month surprised me with their coverage of me joining Mozilla.

I’m having a great time at Mozilla so far, and it’s great to be out in the open working with so many people now on Bespin and ServerJS.

Kevin Dangoor: MichiPUG meeting Thursday: WSGI web frameworks

Kevin Dangoor — 2009-02-02T13:08:31+00:00

Reminder of Thursday’s MichiPUG meeting:

The next MichiPUG meeting will be on Thursday, February 5th at 7PM. Kevin Dangoor will lead a discussion/demo on building your own custom web frameworks with WSGI. As usual, the meeting will be at the SRT Solutions office in Ann Arbor..

Kevin Dangoor: Paver 1.0a1 recalled

Kevin Dangoor — 2009-01-29T15:03:35+00:00

It turns out that both pip and easy_install have trouble with the Paver 1.0a1 package. I’m going to look into that, but in the meantime I have removed the Paver 1.0a1 tarball from the cheeseshop so that people don’t accidentally get it. Sorry about that!

As a side note, it is unfortunate that easy_install and pip both will pick up alpha and beta releases in preference to release versions. I would think that a nicer default would be to prefer the current release version unless there’s a flag saying “give me the test release”.

Kevin Dangoor: Paver 1.0a1 is out

Kevin Dangoor — 2009-01-28T20:59:57+00:00

I have just pushed Paver 1.0a1 up to the Python Cheeseshop. This is very much an alpha release, so beware. That said, I’m successfully using it in my own projects and have been for some time.

I have significantly changed the way Paver works, and I think the new structure is simpler and more flexible because it is no longer tied to distutils. In fact, Paver’s task running capability is in paver/tasks.py and that module could conceivably be used standalone. And, the namespace of tasks is not muddied with a bunch of distutils tasks if you’re making a pavement for some other purpose.

But, the distutils/setuptools integration still exists and is easy to turn on.

Paver 1.0a1 has a handful of useful new features, including the ability to run separate sub-pavements (in the same process, no less).

The docs on the Paver site are still for 0.8, and I will leave it that way for now. When you install Paver, you can run “paver paverdocs” to see the docs for the version of Paver you are running.

Please report any bugs you find either to the googlegroup or directly to the tracker at googlecode.

Thanks to Marc Sibson, Bryan Forbes, Juergen Hermann and others who have contributed to this release.