There were many excellent talks of both a technical and general nature – leaning heavily towards the technical, but that more or less suited the participants (I won’t say ‘audience’ because at an unconference there is no real seperation between organizers, presenters and audience!)

At some point we all gathered ourselves together to show solidarity with the 120 people in Wellington hashing out the PublicACTA declaration that day, via twitter. It was unfortunate that we’d already announced the date for the barcamp by the time PublicACTA was announced, as there were certainly several people who would have liked to have gone to both events (including moi!).

#bcchch showing their support for #PublicACTA

As one of the nominal unorganizers of this particular unconference, I’d particularly like to thank CII for hosting the event, my co-unorganizer Pete for doing much of the publicity, getting the ball rolling, and buying the beer, Stephen for organizing the Pizza and doing much of the MC work once things got going, and everyone who showed up, got into the spirit of things, and shared a great day of talks with us, despite it being nice and sunny outside!

A few highlights of the barcamp for me included:

Rus Werner from CrowdFusion gave us a quick demo of how to put together a website using the CrowdFusion framework, which looks to be a highly advanced content management system targeted at large group blogs, but capable of supporting all sorts of content management scenarios. Rus is the only NZ based developer, the rest of the team were in LA that day to put their latest client live – TMZ – which is one heck of a big site.

We were very pleased to have CJ down from Wellington and she joined her fellow Hitlab member Rob Ramsay to talk about a really fascinating idea they’ve had for combining augmented reality and the DigitalNZ APIs into a new kind of mobile-web game. Actually it appears to have got a long way past just being an ‘idea’ and we’re eagerly looking forward to seeing this come to life later this year.

Later on in the day Pete wowed us with his demonstration of what’s possible with HTML5 and Webkit, culminating with a live demo of the Quake engine running at 30fps *in the browser* – I had already heard about this awesome demo (done by some Google guys to show off what’s possible with HTML5 these days), but it’s another thing to actually see it running.

It was great to hear that we have a Camino developer in Christchurch, and Chris gave us an update on the Camino project, entitled ‘Not dead yet!’ or something along those lines. I asked about what it might take to get extensions into Camino, and he seemed open to the concept. My feeling is that it will be best be done using the new Mozilla Jetpack framework, as that does not use any XUL, which Camino avoids in favour of native Mac ‘Cocoa‘ componentry.

My old friend Neil from Screaming Duck software talked about his new lightweight browser plugin (plugin as in something like Flash, rather than an extension like Interclue) ‘thefbi‘ that allows for a subset of native x86 code to run inside a sandbox in the browser. I think there may well be a niche there despite the fact that HTML5 may make most plugins irrelevant in the long run (and many of us would be very happy about that).

Andrew from Morningstar Security gave an overview of the huge scan of NZ based ‘websites’ he originally presented at the last Kiwicon. Apparently lots of really crazy stuff has public facing content on Port 80 these days – Printers, Voip-phones, drilling equipment, you name it. Much of this stuff should only be available behind a firewall or at least a login, but as you would expect, this is not always the case.

Personally I did a presentation about “Personal Idea Management” and although it was ok, I put it together in a bit of a rush and didn’t really get in all the “ideas about ideas” that I wanted to. I got some good feedback afterwards and I look forward to reworking the presentation and giving it another go sometime in the future. Maybe as a Pecha Kucha talk, or at another unconference. At the very least I’ll make a blog post on the subject at some stage! For this talk I was mainly talking about the special class of ideas that could form the core of new tech projects (or even new startups), which is a type I am particularly prone to. This is a pretty tiny subset of the general field of “ideas”, and although in an ideal world one might have software custom designed to help out with it, it’s probably going to be handled mainly within the standard note-taking / brainstorming apps such as Mindmappers, Hierarchical Outliners, and Personal Wikis. I have tried a bunch of these and have never quite settled on one I’m totally happy with, or a system that was in any way ideal, but working on this presentation and the feedback I got afterwards has definitely given me some ideas and I look forward to trying them out. Since the presentation I’ve had two new ideas for iPad apps, and they will join the backlog of 50+ things we could be building if we had any spare capacity right now. Certainly I look forward to the day when some of that backlog hits the front burner!

Many of the folks at the barcamp said we should have another one soon – which hopefully means “within the next year”! I may or may not still be living in Christchurch at the time, but I will try to be there regardless! Remember there’s nothing stopping anyone from getting another barcamp ball rolling at any time, anywhere. Come up with the nugget of a plan, make a post to barcamp.org about it, tell your friends, and you’re on your way! I may make another “lessons learned” post with a few hints about what went right for us and what went wrong this time around, but really all the info you need is at barcamp.org, and if I do make that post I’ll try to find a place for those thoughts there as well.

Anyone who missed Barcamp but would like to present a tech talk in an informal setting, I encourage you to come along to a Spacecraft gathering, and let people know in advance what you’ll be talking about. There are also the monthly TVIC tech dinners – the last one was very good with possibly as many as 20 geeks in attendance.

Following up on my previous post about the Christchurch Digital NZ hackfest, I did find the bug in my search plugin script, it was just one of those minor typos that takes ages to find because the error message you got when you tried to use it was completely uninformative. Sigh. However, since I spent most of my time on this during “Mozilla Service Week” I chalked up a few hours there to add to their total. Kudos to Mozilla for organising that and I’ll be sure to take part in a more serious way should they do it again.

Digital NZ has created a Custom Search Builder, and it seems to me that they could add Search Plugin generation to this reasonably easily. All they need to do is take a copy of my sample and use it to create a template the swaps out the content of the ShortName and Description tag, and also the template attribute in the <url> tag – everything else can stay the same. Then they need to add a javascript install link to the search result pages similar to the one here.

Heres what my sample search plugin file looks like (NB: First bit of code I can recall posting in this blog. I promise not to make it a habit.)


<OpenSearchDescription xmlns="http://a9.com/-/spec/opensearch/1.1/"
xmlns:moz="http://www.mozilla.org/2006/browser/search/">
<ShortName>Digital NZ</ShortName>
<Description>Digital NZ Archive Search</Description>
<InputEncoding>UTF-8</InputEncoding>
<Image width="16" height="16" type="image/x-icon">data:image/x-icon;base64,[data string goes here]</Image>
<Url type="text/html" method="get" template="http://search.digitalnz.org/en/search">
<Param name="search_text" value="{searchTerms}"/>
</Url>
</OpenSearchDescription>


The Webserver has to serve up that XML file with a MIME type of application/opensearchdescription+xml

eg using apache, in a directory where .xml isn’t reserved for anything else, one could put this in a .htaccess file:

AddType application/opensearchdescription+xml .xml

It’s also relatively trivial to add something to the headers of a webpage to enable autodiscovery of one or more search plugins. I’ve done that on my example page. Once you’ve done so it’ll appear in the search plugin manager for the browser, like this:

For more details, and how to do other cool things like enabling search completion, see:

OpenSearch Specification
Mozilla article on creating OpenSearch Plugins for Firefox

Among the various hacks there was an iPhone app and a Drupal module, and I got most of the way through building a Search Plugin for Firefox and IE, which is a relatively trivial hack in theory but I’d never built one before so it was a useful learning experience.

Unlike fully blown browser extensions such as Interclue or Lazarus, search plugins are just an xml file that when loaded using a special javascript method (only available in certain browsers, such as Firefox 2+ and IE7+) will cause your browser to create another search provider for the search box, which by default in Firefox only has a few general purpose search engines such as Google and Yahoo available, and a few site specific ones such as Wikipedia. But anyone can create a new search plugin for the search on their website, and getting users to install it can mean that they come back to your website more often.

I found a few little niggles, such as that the xml file had to be served up with the right MIME type by the webserver, and that the best way to provide the icon was using a “Data URI” – essentially a way of encoding an image using text. Fortunately Hixie has a kitchen for that.

My attempt is here, and in theory it should install fine in IE7+ and Firefox2+ by clicking the link on this page, but so far, it doesn’t, and I’m not quite sure why. I’ll update this post once I’ve fixed it! [update: fixed]

DigitalNZ has a “roll your own search engine” system set up for their growing collection of Digital Kiwiana, and it should be simple enough to extend that system to build a search plugin for each derived engine, since they will share the same pattern apart from the target URLs. There are also standards for search completion (guessing what you want to search for) and autodiscovery. I’ll make another post in a couple of days once I’ve had a chance to figure it out properly.

[updated because I forgot their mission was only to index the metadata, the digitizing and putting online bit is up to the contributors and partner organizations]

Provisionally, I am inclined to blame this tweet, which eventuated shortly after this post. Cheers Fred.

I expected the download rate to tail off after that. However, it’s actually steadily increasing, thanks to a spate of retweets and blog posts from people like Rick Broida, who is syndicated all over the place. We might clock over 100,000 installs for the week at this rate. That would put Lazarus in the the top 20 Firefox addons, maybe even top 10. Unfortunately I can’t tell right now because the AMO stats are broken – the last 5 days of traffic haven’t been processed for some reason. So everyone’s weekly numbers are currently way off. That may be fixed by the time you read this post, of course.

A few weeks ago I was talking to my advisors about whether we should be focused on Lazarus or Interclue. I argued that Interclue had better long term monetization prospects, and showed them my marvelous J-curves. Nat pointed out that Lazarus had the more obvious value proposition and some incredible user feedback. I threw a few ideas into the ring on how we could extend and monetize Lazarus, and it was mooted that it would be best to get at least one of those ideas into action before we started to actively promote it. However, it appears that active promotion wasn’t exactly required in this case. We appear to have entered a cycle where every time someone complains in a tweet, on a forum, or in their blog that they just lost a pile of text they typed in, someone else chimes in and says “Got Firefox? Get Lazarus.” or words to that effect. Hence we have some pretty impressive word of mouse going on right now.

[UPDATE: It appears there was a bit of a stats glitch! We were never getting more than ~5k installs / day for Lazarus. However, ~5k/day is still very impressive and a considerable boost over what we were getting before that]

Some good news. Lazarus Form Recovery, our little side project, has risen through the ranks and joined Interclue on the AMO “recommended list” – probably the highest accolade available in the world of browser add-ons, apart from perhaps a glowing review in the Mossberg column, as our colleagues at Surf Canyon recently achieved.

The AMO directory (addons.mozilla.org) is linked directly from the Firefox Tools|Add-ons menu, and add-ons from the recommended list are even featured within the browser itself, so the 30-40 add-ons on that list do get a lot of exposure, and having two in there at once really is a great honor, given how many they have to choose from.

I’ve been asked a few times how we managed it. The short version is in both cases I wrote to Mozilla and explained how our addon met their criteria for recommendation, which you can read at the bottom of this page, and not long after that they were recommended. So it’s really about having the right sort of add-on and the right sort of reviews, rather than doing much in the way of lobbying or cajoling.

Most of the credit goes to Karl, who put a lot of effort into making Lazarus almost flawless. My only significant contributions were the original concept, a few innovative implementation ideas (eg asymmetric encryption to get around having to enter a password), and letting him avoid our Interclue todo list for a month or three. It took a while longer to get Lazarus right than we expected, there are a bunch of edge cases where form recovery is hard, but we felt it was worth chasing them all down so we could honestly say “Never lose anything you type into a web form again”.

Part of the Interclue Manifesto says “We will never stop looking for more ways to increase the value of the time people spend online.”, and certainly being able to recover hours of typing that otherwise would have been lost has increased the value of my time online, and from the ecstatic reactions we’ve gotten from Lazarus users, I’d say we haven’t strayed too far from our core mission.

Here are some snippets from Lazarus reviews on AMO:

I guess that means they like it

It’s also gotten good feedback from tech bloggers who picked up on it. Not a lot of mainstream attention so far, probably because I haven’t contacted any of them, but hopefully that will come with time. Hey Walt, about that column of yours….

Many of you will know her as the founding editor of the uber-famous (well, in tech circles) Lifehacker, a phenomenally successful blog covering tips, tricks, software and sites that offer a multitude of ways to improve your workflow and lifestyle. Sadly, the sheer number of suggestions forced me to stop reading Lifehacker a while ago – chasing up all those potential speed improvements wasn’t helping me get anything done in the short term! I’m looking forward to achieving a somewhat more measured pace of life improvement from reading Gina’s new blog; Smarterware.

The fact that so many of these posts were of good value, and the fact that Gina was churning out a dozen or more every day, day after day after day, is certainly a Heroic feat in my opinion. I don’t think I’ve managed a dozen blog posts inside a single month, let alone in a single day.

While researching Gina’s life (a remarkably easy task, given how much she has written or had written about her in the last decade), I discovered an article that mentioned the genesis of Lifehacker – it turns out she was already working for Nick Denton as a coder when he bought the domain name, and her enthusiasm for the what could be done with it made him offer her the editor job on the spot. Many will realize this was probably one of the best HR decisions Nick made in his life, and it has to be said he’s made some good ones in his time.

“The one blogger I wished we had landed at Weblogs, Inc. was Gina Trapani from LifeHacker. I tried every two months for a year I think… no offer was good enough. Very, very frustrating.” – Jason Calacanis

To go from being a full time professional coder (with a pretty impressive resume) to being a full time professional writer is no small feat. Both involve using a keyboard and your brain – after that the similarities start to die off pretty fast. So that’s another reason Gina is a Tech Heroine.

I was actually aware of Gina well before she started Lifehacker, in that she was one of the few girl geeks who was seriously blogging, and there was a time (pre-2004) when just running your own blog qualified you as being moderately cool. I looked in the WayBackMachine and discovered she’s been blogging since late 2001 – which makes her a serious early adopter. Here’s her first post.

Another reason she’s among my Tech Heroines is that she’s the author of quite a few Firefox Addons, and I would say she’s contributed just as much to the success of Firefox through constantly blogging about Firefox and Firefox add-ons on Lifehacker, and providing early examples of add-ons for people to learn from, as almost anyone who actually works for the Mozilla Foundation. They should give her a medal or something. One of the earliest “Top X Firefox Add-ons” lists features her app “About this site”.

For reasons that may not be immediately apparent, the success of Mozilla ranks up there with the success of Google, Wikipedia, and the W3C as reasons why the web is so damned useful today, as opposed to mired in a morass of crappy over-commercialized portal sites and walled gardens, so Gina’s contributions to the success of Firefox are no small thing in the world of Tech Heroism.

Gina has said that her book is one of the things she’s most proud of, so I really must get around to buying it sometime soon. [2] Her book is called “Lifehacker – 88 Tech Tricks to Turbocharge Your Life”.

If you can’t wait to get the book, or don’t feel like perusing thousands of lifehacker articles for your dose of wisdom from Gina, the interviews she gave to Tim Ferris and The New York Times should at least whet your appetite.

It’s not for nothing that in 2007 she was ranked 7th by Forbes in a list of 25 Web Celebrities, one above Mark Zuckerburg, the founder of Facebook.

Herein endith my tribute to Gina Trapani. To read about more Tech Heroines on Ada Lovelace Day, check out this huge list of posts, which is also available referenced by subject, and the locations of the bloggers writing about them!

[1] “Today” being a somewhat amophorus concept for me. Lets just stay I started this post on the 24th, NZ time, and will finish on the 24th, American time.

[2] My book reading has slowed to a crawl now the internet feeds me pretty much everything I need, but I make exceptions. It doesn’t help that book prices in New Zealand are at least twice what they are in the USA, if we’re lucky. This is another reason the internet is a great leveller – eliminating the edge once enjoyed by readers in large markets with better enconomies of scale. Imagine what it would be like if everything on the internet was priced differentially by where you lived, or you weren’t allowed to watch clips from an upcoming movie because it wasn’t available in your country….ok, bad example. Eventually the creative industries will realise how batshit crazy they are to do this to their international fans.

On the other hand we also started getting a lot more uninstalls, mostly due to usability flaws that became obvious after we started getting users who really had no idea what they were getting before they installed – the ones who read the first paragraph of the description on addons.mozilla.org and hit “install” because if Mozilla was recommending it, so it had to be worth a go.

Obviously, you can’t please everyone, and it’s pointless to try. But we’ve been working hard to increase the general usability level of Interclue in the past few months, and also to make it fully compatible with Firefox 3 before the official launch, which happened last Tuesday.

As a result of that hard work we’re actually keeping most of our new Firefox 3 users, many of whom are installing Interclue right out of the Firefox 3 add-ons manager, with very little idea of what to expect. It’s impossible to tell how many we’re getting from the add-ons manager vs people visiting addons.mozilla.org – I’m guessing maybe about half?

Currently we’re running at ~ 6k/installs/day, after slowing to “only” 5k/day over the weekend (we always get fewer installs on the weekend). During Download Day we gained almost 13k new users, and peaked at over 1000 installs an hour.

Lots, huh? Not so many when you consider Firefox 3 itself was getting downloaded over 15,000 times per minute at one point during launch day.

The codebase that runs addons.mozilla.org (a.m.o) is called “Remora” – which isn’t entirely a fair analogy – Firefox is certainly a leviathan of a product and we’re benefiting hugely from being attached to it, but there’s a more symbiotic relationship than the one you find with real Remora. I’ll explain what I mean by that in a subsequent post.

To cut a long story short, Trond, Paul and I are now 4 days into our Android Hack-a-thon and we’ve made some reasonable progress, Particularly Trond who has been going great guns on the UI side of things. We have about 25hrs to go. Can we complete an app that will crack the top 50? Remains to be seen.

Part of me feels guilty because Interclue requires my full focus at least until we get to break-even on cashflow (which we’re not even close to on donations alone…), but I could see there was an overlap in the technologies we would need for the Android project and those we will be using for the subscriber extensions to Interclue, and although I come up with new product ideas pretty often, this is the first time I’ve allowed myself to get past the “idea” phase on a new one for over two years, and there is a definite cutoff point (30 hours away now) where my attention can switch back to Interclue, which I have been keeping half an eye on in any case. So I decided I could risk it just this once. I promise not to make a habit of it!

BTW there is some particularly awesome news about Interclue that I haven’t formally announced yet. Will do so soon. Let’s just say that it’s going great and I’ve got no intention of sidelining it in favor of a new venture in Android Application Development, but if we do win one of the 50 $25k prizes then I’ll have to at least give this at least enough attention through June 30th to have a crack at the $275k and $100k prizes, and based on the experience gained “Interclue for Android” will be looking good for the next $5m challenge contest happening later in the year!

PS: Rob O’Brien and Marek Kuziel, who were both sadly too overloaded with stuff to give me a hand with this, are organizing a Mobile and Identity Barcamp in Wellington near the end of the month. Go if you can, I’m sure it will be awesome.

Update: We did not make the top 50, but we were apparently in the top quartile for all 4 judging categories, which suggests we could have been pretty close. Not bad for <5 days effort when the competition had been running for 5 months, in any case.

TVIC is the second thursday of the month [2], but I’ve only just gotten the video I took off my Treo – I’ve been having problems with my sync softhardware, and with the impending launch of Interclue 1.5 [3], a bit too distracted to figure them out. Sorted at last, though.

For this particular TViC, Phil had inspired Marek to go hunting for dead CD-ROM drives we could take to bits in search of useful components. Unfortunately the call went out about a month after I threw out my own half dozen deaders, but Morris had a stack just as large, so the scene was set.

After dinner we went to the Bohemian, near the Incubator, got pints, and got out the screwdrivers. I’m really not sure what the rest of the clientel made of us, but the staff didn’t seem to mind us using their table as a workbench.

For a while it was “who’s got the 2nd smallest Phillips”, “did anyone bring one of those star-shaped drivers?”, and of course “who’s for another beer?”

The best things inside CD-ROM drives aren’t circuit boards (what sort of “boards” did you think I was talking about in the title?) but rather motors, gears, magnets, sliders, switches and LEDs. We found that the old drives were the best – less custom-designed plastic bits, more off the shelf components and metal bits.

The hardware hack of the night came after Morris used a DC motor wired to a CD-ROM tray slider as a DC generator to power a blinking red LED, when Phil suggested hooking up a green one with the opposite polarity…

Geektacular!

Marek took all the bits home afterwards. I have no idea what he’s going to make with them, but I’ll be standing well back when he demonstrates.

[1] Pssst! TVIC needs more girlgeeks! And well, more people in general actually. If you find this post amusing you’d probably fit in.
[2] Well, for the moment. It’s possible it’ll move back to Tuesday. Also, I think dinner needs to move to somewhere with an on-licence.
[3] It’s not too late to give us feedback on the new beta version

See the hint next to the magnify cursor you get when you mouseover a thumbnail in a the new clueviews? When you mouseover the comics in XKCD you can usually see a little in-joke in the title hint. Sometimes, the titles are pretty long, and Firefox the tooltips don’t wrap. This has been a subject of some complaint, but thankfully, with the landing of the infamous reflow branch (count the dependencies!), this will be resolved in Firefox 3.

Yep, in the 1.5 Clueviews, images of sufficient size are thumbnailed, you can click to see the image full size, and then click again to go back from there. It’s pretty cool, and we think it’s a good compromise to showing no images, or a full size window with all the images, like Cooliris does (frankly, if I wanted to see the whole page, I’d just open a new tab).

I love this cartoon, and I wish he’d put it on a T-shirt, because Turing featured in one of my favorite assignments [1] while I was at UC, where I majored in Philosophy and Computer Science.

I was never a great academic, far too scatterbrained most of the time, and being up till 3am most nights running my BBS, playing Civilization, or online backgammon (FIBS 1700+, back when that was actually pretty good), sure didn’t help, but I do have my name in the credits of one academic paper, “On Alan Turing‘s Anticipation of Connectionism”, because our logic lecturer, who later went on to become co-director of the Turing Archive, discovered a mostly ignored paper by Turing from 1948, in which he definitely did anticipate “Neural Nets“, which is pretty amazing given that at the time there was only one non-specialized computing machine on the entire planet, ENIAC. [2]

Unfortunately, Jack couldn’t figure out how to make Turing’s “B Type” networks actually compute something, so in a brilliant combination of laziness, sadism and cunning, he gave his 3rd year students the option of skipping one our 20% take home assignments for the year, and instead figuring out how to make Turing’s type B networks work.

It was fun trying. In the end, I was one of about 3 students who instead succeeded in making a logical proof that these networks couldn’t work, (as specified by Turing, anyway). As I recall, I had to prove it 3 times, the last by structural induction, because Jack couldn’t accept that Turing might have got it wrong. He gave in eventually and I got full marks.

I put this achievement at the top of my list of 10 things I’ve done you probably haven’t, back in Feb 2005. Number 10 on that list was in fact Interclue, which was in the prototype stages even back then. It took a bit longer than expected to actually get it out, to same the least. I blame Hofstadter’s Law. But I’m really happy with the new beta so far, although it’s going to need some testing and tweaking, and we’d love your feedback. So if you’ve got firefox, go for it!

[1] And one of my favourite books, Cryptonomicon by Neal Stephenson

[2] Although others were under construction, and Turing had a hand in two of them – see Jack’s “A Brief History of Computing” for details).