Site review: Yahoo Pipes and Teqlo allow you to make your own monster mashups

Here we mash data feeds and applications with Yahoo Pipes and Teqlo

Written by David Tebbutt

Two kinds of end-user programming tool have been doing the rounds recently. Both run in the browser and each takes a building block approach to creating useful software functions.

Pipes, which comes from the Brickhouse product incubator within Yahoo, provides a promising way to merge, filter and manipulate a collection of incoming RSS feeds and output the result as a single feed.

Teqlo, on the other hand, provides a way to join different software “widgets” so that information flows automatically between them. You could, for example, make a simple RSS aggregator by joining a feed widget to a feed reader widget.

Both Pipes and Teqlo are hosted and still in beta. Pipes is the more developed, but both are undergoing continuous revision in the light of user feedback. They both need more building blocks although each can be used as it stands. IWR is looking at them because they are among the first to bring the user into the application development equation without requiring programming skills.

Only time will tell whether they end up being the frontrunners in data and application mashups. Pipes has a freebie air to it, while Teqlo comes across as more businesslike. They are free to use right now, but don’t be fooled: software services such as this won’t survive unless they pay the rent. Users pay in the form of attention, personal details, help or money, sometimes moving from one form of payment to another as their needs change.

Pipes
A Yahoo Pipe accepts user input and a number of RSS feeds which it then filters, shapes and spits out as a new RSS feed. The filtering follows a set of rules that you create by dragging and dropping function boxes into the work area, or “canvas”, and joining them together with what look like blue pipes, hence the name (which is also a nod to the pipe function in Unix).

User inputs appear as a form with text boxes for each value. They might include feed names, search terms, number of output feeds, dates, and so on. Feeds can come direct from a feed URL or from searches built into the Pipes system. Not surprisingly, Yahoo Search, Yahoo Local and Flickr (another Yahoo property) loom large here. Goods and services locator Google Base is also listed.

The number of pre-built search functions is restricted, although you can fairly easily add your own if you already have Technorati watchlists or know how to construct a search URL for your favourite search engine, providing it can output results as RSS. Some well-known ones can’t.

Once your incoming feeds arrive at a function box you can look inside using the debug area at the foot of the screen, which displays each feed item as a collapsed outline. Expanding it reveals all the XML field names and their contents. This lets you see exactly what’s coming through inside the feeds, and it becomes even more useful when you start merging feeds and performing filtering actions on them.

It’s important because RSS feeds are not all the same. They contain different fields, and information is not always in the field or the format you expect.

You can split an incoming feed into duplicate processing streams and subsequently consolidate them with the union command. You can copy and rename elements within the feed, change the content and add information. But it’s early days and some manipulation functions are not yet available. Others, such as Content Analysis, look intriguing, although this particular function promises much but delivers only the crudest of analysis.

The BabelFish translation is what you’ve come to expect from this service: useful for reading foreign language documents but less so for publishing them. The regular expression engine is excellent for transforming fields from one format to another. Regular expressions appear intimidating to the uninitiated, but they’re worth learning for the flexibility they give you.

There’s more, of course, but why not visit pipes.yahoo.com and look at some of the published Pipes yourself. You can not only run them, but, if you’re signed in, you can see how each was made.

Teqlo
While Pipes is all about manipulating RSS feeds, Teqlo sets out to enable different widgets to work together. If, for example, you have some eBay search results coming in, you can feed them straight over to a mapping program and pinpoint where the sellers live. The eBay service is quite separate from, say, Google Map, and Teqlo takes care of all the hard work of calling on the widget services and passing the results between the modules.

Like Pipes, Teqlo offers a set of widgets that can be dragged onto the screen canvas. But Teqlo applications are much more visible to the ultimate user, so the tool lets you work with layouts and colours, to mirror your intranet style, for example. You can even have multiple canvases for different screens within the application.

To make most things happen in Teqlo, you need at least two widgets. The company is busy building a foundation catalogue, but expects to add independently developed widgets as well. Some will be free, others for rent and, no doubt, others will carry advertisements as their form of payment. If this widget economy takes off, it could lead to much deeper functionality than exists at present.

At the time of writing, the widget catalogue contains 13 major items, including eBay search, five Google functions, a YouTube viewer, RSS feed and reader and some business contact items. Some of these are umbrella terms for a collection of widgets. Google Gadget, for example, contains eight popular functions, one of which can select any of over 4,000 Google Gadgets for inclusion in your page.

The more interesting items are those that trigger searches, bring back the results, then feed them to other widgets for further interpretation. For example, the RSS feed passes its results to the feed reader, which displays the feeds and the text for the currently selected item. This could be linked to an emailer to send the feed, or extracts of it, with the user’s own comments, off to the recipient of choice. Many blogging services accept email as input, so you could use Teqlo to create a simple blogging application.

At the time of writing, the definitions of “actions” and “reactions” was done by selecting the elements from drop-down menus, six in all. An action might be “select an item in a list”, the reaction might be “plot the location on a map”. Teqlo recently demonstrated a pre-beta that reduced this definition effort to a simple drag-and-drop exercise. The drop-down menus are still there for people who prefer it.

One Teqlo developer built a Pipe to collect information about traffic accidents in the San Francisco Bay Area, using the responses to access a Google Map. A watcher widget called the Pipe periodically and only reacted if an accident occurred on the user’s route home.

The way forward
Both of these services are in the early stages of development. While Pipes is about mashing up data feeds, Teqlo is trying to orchestrate the inputs and outputs of widgets that were never designed to work together. In the longer term, if successful, Teqlo is likely to be used to build complete applications, whereas Pipes looks as if it will be one more element in the Yahoo product family.

Each company provides its services through the browser. Both are good with Firefox. Pipes works with Firefox, Internet Explorer 7, Webkit and Safari, in that order of preference. Teqlo is Firefox 2 only at the time of writing, with IE7 on its way.

The idea behind both services is that users should be able to build “mashup” applications without recourse to the IT department. But, if you cannot sign up for externally hosted web services, then you will be out of luck.

reader comments

related articles

 

Serena offers on-demand mashups

Faster and easier to deploy, claims firm 10 Sep 2008

Cognos offers personalised business intelligence

Interactive features added to latest Cognos 8 software 03 Oct 2008

Widget Press offers painless iPhone apps

Point-and-click toolkit does away with the need for coding 09 Jan 2009

related whitepapers

today's top stories

Lack of enterprise appeal takes shine off Chrome OS

Enterprise buyers unlikely to ditch Windows for Chrome OS in the near term, say experts 09 Jul 2009

How Satyam cleaned up its act

Chief executive CP Gurnani tells Angelica Mari why Tech Mahindra opted to keep the Satyam brand after it bought the scandal-hit services firm, and explains what the deal means for existing and prospective customers 09 Jul 2009

Open source bites back

Recession-hit companies are tired of vendors holding a gun to their heads over software licensing, says CEO of Ingres 09 Jul 2009

"We will ensure Britain remains at the forefront of the digital revolution"

As new trials of superfast broadband get under way, minister Pat McFadden explains the government’s digital vision 09 Jul 2009

Put social networks to work on your career

Increasing numbers of IT professionals using sites such as LinkedIn to grow contacts and find jobs 09 Jul 2009

Advertisement

Newsletter signup

Sign up for our range of FREE newsletters:

More available - click 'submit' to view

Existing User

Newsletter user login:

Advertisement

Jobs

Related jobs

Job of the week

Job alerts

Sign up here

Find your next job

IT Salary Checker

Check salary here

Advertisement

White papers

Search white papers

Top categories

VPN, Extranet and Intranet Solutions

WAN/ LAN Solutions

Network Security

Interoperability-Connectivity

Grid/ Utility Computing

Latest poll

Would you use social networking sites to look for a job?

Would you use social networking sites to look for a job?

Tell us what you think about job hunting through LinkedIn, Facebook, Twitter etc

View poll results

Latest audio and video articles

network cablesVideo

How to maximise the value of your IT networking investment

A panel of experts discuss networking strategies that deliver real value to business 03 Jul 2009

green footprintsVideo

How to manage enterprise energy use - and the role IT can play

A panel of experts explore how firms can get to grips with their carbon footprint and make smarter use of energy 01 Jul 2009

Latest in-depth articles

Google ChromeAnalysis

Lack of enterprise appeal takes shine off Chrome OS

Enterprise buyers unlikely to ditch Windows for Chrome OS in the near term, say experts 09 Jul 2009

Satyam CEO CP GurnaniNews

How Satyam cleaned up its act

Chief executive CP Gurnani tells Angelica Mari why Tech Mahindra opted to keep the Satyam brand after it bought the scandal-hit services firm, and explains what the deal means for existing and prospective customers 09 Jul 2009

Advertisement

Primary Navigation