Help - Search - Members - Calendar
Full Version: Corsair - Rss/podcast Aggregator
OESF Forums > General Forums > General Support and Discussion > Software
Pages: 1, 2
tiny ogre
I've recently written and released Corsair, an RSS and Podcast Aggregator for Qtopia. If you don't know what that means, follow the link and read the FAQ smile.gif

It's actually being developed for the Archos PMA400, not the Zaurus, so this may not work at all for most of you, but from what I've read there's some chance that even the binary package will work on Zaurus, so I think this is an appropriate forum. If not, the source is there and maybe someone will find it useful and portable to the Zaurus too. I'd love any feedback from anyone who tries it.

It writes all data to $(HOME)/Documents/corsair and subdirectories thereof. On a PMA, that maps to /media/Documents/corsair. I don't know what it will map to on a Zaurus, hopefully something sensible! ("$(HOME)" is actually determined by Qtopia's homePathDir())
Magellan
I can't get it to run on my C750 with Cracko 1.22a. It just doesn't start after selecting the icon.
mistermix
It works fine on my C3000 - in fact, it is pretty darn nice for a .2 release.

I'll bet that the problem encountered by Magellan was that he needed libqtopia. Apparently, QT applications that are built with the 1.7 version of the QT SDK, such as those for the Archos, use this lib, but the Sharp apps, built against version 1.5 of the SDK, do not.

In any case, I was able to find a copy of

qpe-libqtopia_1.6.0-13.arm.ipk at

http://www.apex.net.au/~twalker/qtjournal/

and corsair worked fine after installing that.
Magellan
Hmm. I installed that file, and I still can't get it to work.
mistermix
Below is an ldd for corsair. Looks pretty basic except for perhaps libstdc++.

Perhaps you're missing libstdc++2.10-glibc2.2 ? I think there's a copy in the Cacko feed.


CODE
ldd corsair
       libqte.so.2 => /home/QtPalmtop/lib/libqte.so.2 (0x40022000)
       libqpe.so.1 => /home/QtPalmtop/lib/libqpe.so.1 (0x40430000)
       libqtopia.so.1 => /home/QtPalmtop/lib/libqtopia.so.1 (0x405c0000)
       libjpeg.so.62 => /home/QtPalmtop/lib/libjpeg.so.62 (0x4061e000)
       libuuid.so.1 => /lib/libuuid.so.1 (0x4064b000)
       libstdc++-libc6.1-2.so.3 => /home/QtPalmtop/lib/libstdc++-libc6.1-2.so.3 (0x40656000)
       libm.so.6 => /lib/libm.so.6 (0x406a1000)
       libc.so.6 => /lib/libc.so.6 (0x406cf000)
       libdl.so.2 => /lib/libdl.so.2 (0x407ea000)
       libcrypt.so.1 => /lib/libcrypt.so.1 (0x407f5000)
       /lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0x40000000)
Magellan
Yep, it works now. That is the file I needed. Thanks!
tinyrooster
This looks cool. Any ideas about whether it will work on a 6000?
kb7sqi
QUOTE(tinyrooster @ Sep 22 2005, 08:11 PM)
This looks cool. Any ideas about whether it will work on a 6000?
*


I use it on both my 5500 running TKC Rom & on my C3000 running Cacko.
Just make sure you install the packages mentioned above. It's a handy program
for a 0.20 release! Take care.
jagrka
I welcome this program to the Zaurus scene. I've been using my SL-C760 with Sharp ROM 1.40JP to listen to podcasts for the last few months. I usually accomplished this by downloading them from iTunes and then manually copying them to my Zaurus. The best feature is that it can queue downloads of multiple podcasts.
Although the program is functional for downloading and tracking podcasts, the current state of the program has several significant problems.
1. The ability to play downloaded podcasts from within the program does not work. It appears to try to send a command to play the program in some application. My screen will fade to white while it appears to try to launch something in portrait mode.
2. The "info" button pic does not display. I noticed that the ipk does not include a pic file for this button.
3. I usually listen to podcasts with musicplayer, when I downloaded them with iTunes, it automatically appended tag information to the files. I miss not having this tag information in the file, particularly since I am unable to play the files from within Corsair.

Since this program was not written especially for the Zaurus, it would be nice if someone could re-complile and cleanup the code so it is optimized for the Zaurus. I think that would fix most of the problems noted above.
mistermix
Attached is an ipk I built that addresses issues (1) and (2). I was unable to get the musicplayer application to launch and run a file, so it uses kino2 instead. If someone has some working code that launches musicplayer and plays a file, please post it and I'll incorporate it into a new ipk.

QUOTE(jagrka @ Sep 24 2005, 09:36 AM)
I welcome this program to the Zaurus scene. I've been using my SL-C760 with Sharp ROM 1.40JP to listen to podcasts for the last few months. I usually accomplished this by downloading them from iTunes and then manually copying them to my Zaurus. The best feature is that it can queue downloads of multiple podcasts.
Although the program is functional for downloading and tracking podcasts, the current state of the program has several significant problems.
1. The ability to play downloaded podcasts from within the program does not work. It appears to try to send a command to play the program in some application. My screen will fade to white while it appears to try to launch something in portrait mode.
2. The "info" button pic does not display. I noticed that the ipk does not include a pic file for this button.
3. I usually listen to podcasts with musicplayer, when I downloaded them with iTunes, it automatically appended tag information to the files. I miss not having this tag information in the file, particularly since I am unable to play the files from within Corsair.

Since this program was not written especially for the Zaurus, it would be nice if someone could re-complile and cleanup the code so it is optimized for the Zaurus. I think that would fix most of the problems noted above.
*
jagrka
Thanks to mistermix for making improvements to this program! It is really looking great.
However, a new problem has arisen in this version--it is unable to download. The podcasts that I downloaded with the previous version appear and play in Kino2 (Excellent!), but I cannot now download new podcasts. When I initiate a new download the progress bar appears and completes the download, but no file is present in /home/zaurus/Corsair/shows for the new download. I ran the program from the console, and it prints a long series of the following errors before concluding the download:

QFile::writeBlock: File not open
QFile::writeBlock: File not open
QFile::writeBlock: File not open
Download::complete(0)
downloadComplete(/home/zaurus/Corsair/shows/NBC News _ Meet the Press/pd_mtp-09-25-2005-074233.mp3)
~Download()

Even though it reports the download complete, there is no new directory or file in /home/zaurus/Corsair/shows. Unlike the SL-C3000, I do not have an internal hard drive. Could it possible be a problem related to the file partition?
Finally, the new version has added a new icon at the top with options for File (Load & Exit), and View (Downloads and Preferences), and Help. Except for Help and Exit, none of these options appear to work. Any chance that the "cancel" key can quit the program instead of having to cycle through the menu to the Exit option?
mistermix
Hmm...download works for me on my 3000. Can you please post the URL of the RSS feed that you're trying to download (or send it to me in a message) so I can test it? Hopefully, the issue is the RSS, not some obscure difference between the 3000 and the 760.

The empty menu entries that you mention are still to-be-built. I usually quit the program by hitting the X in the upper-right-hand corner (i.e., the "close window" button). Does that work on the 760? I thought that this was standard on all Qtopia boxen.
jagrka
I don't believe that it is related to a particular RSS since I experience this with all of my podcasts feeds, which worked in the original 0.2.0 version. For the record, these are some podcasts that I have tried:

<outline text="Battlestar Galactica" brokenXML="false" xmlUrl="http://www.scifi.com/battlestar/downloads/podcast/podcast.xml"/>
<outline text="this WEEK in TECH" brokenXML="false" xmlUrl="http://leo.am/podcasts/twit"/>
<outline text="On The Media from NPR/WNYC" brokenXML="false" xmlUrl="http://www.onthemedia.org/index.xml"/>
<outline text="ABC News Nightline" brokenXML="false" xmlUrl="http://abcnews.go.com/xmldata/xmlPodcast?id=868748"/>
<outline text="NBC News - Meet the Press" brokenXML="false" xmlUrl="http://podcast.msnbc.com/audio/podcast/MSNBC-MTP.xml"/>
<outline text="The Al Franken Show" brokenXML="false" xmlUrl="http://www.sundancechannel.com/al/podcast.php"/>
<outline text="NewsHour with Jim Lehrer Podcast | PBS" brokenXML="false" xmlUrl="http://www.pbs.org/newshour/rss/podcast.xml"/>

I appreciate any assistance in determining the cause of the problem. It would be great if others could post their experiences using the new 0.2.2 version, especially those on SL-C7X and SL-C860.
In the meanwhile, I switched back to the old 0.2.0 version and patched in the pic files from the 0.2.2. It now displays correctly and can download, but I'm still stuck without being able to play the podcasts from within Corsair.
I can also quit by tapping the top-right (X), I was just looking for a non-stylus solution for quitting the application. Thanks again.
mistermix
Thanks--I'm able to replicate the problem with your podcasts. For some reason, it was working with the few I had. I will look into it and post when I find a solution.

Just to be clear, the 0.2.2 designation is mine - the original author has not posted a new release since 0.2.0.
mistermix
Here is a new ipk that solves the problem of feeds not downloading. I broke that while trying to get playing feeds to work. Doh!

Also, the Z cancel key will now shut down the application.

Please report any and all bugs on this thread. Thanks.
jagrka
The downloads are working again. Many thanks!
As I have begun to use the program more often, I have noticed one other small bug: the program quits after refreshing the feeds (selecting the refresh button).
I'm sure some would like to be able to specify the directory where it stores feeds/podcasts, but I was able to do this by creating a symbolic link from the /home/zaurus/Corsair/shows to my SD card.
icruise
This is a VERY promising program (certainly the best RSS reader I've tried on the Zaurus, although admittedly that isn't saying a whole lot...) It's incredibly fast and will actually open links in Opera for me and not NetFront (presumably because I've set mail links to open in Opera).

It seems like it won't read any feed that doesn't end in .xml though. I have some that end in .php and .html and they just won't load. And of course it could use a fair amount of work in the GUI department. But I'd definitely like to see more.
mistermix
jagkra: I will look into the issue of the program dying after you hit refresh.

icruise: Can you post some example feeds that don't work for you?

Also, on the topic of default browser and directory location, there are hooks in the code to support specification of these items in a config file, but the config file has not been implemented yet.

Thanks and keep the bug reports coming...
icruise
QUOTE(mistermix @ Sep 29 2005, 07:08 AM)
icruise:  Can you post some example feeds that don't work for you?


I haven't tried that many yet, but here are a couple:

http://www.the-gadgeteer.com/rss.php
http://www.akihabaranews.com/en/rss.html

Edit: I take it back -- these are both working now. I'm not sure why, though, because these two sites wouldn't work earlier even though I was able to add several other sites without problems.
jagrka
QUOTE(mistermix @ Sep 29 2005, 09:08 PM)
Can you post some example feeds that don't work for you?
*


The podcast for Nightline, which I posted earlier doesn't work. It appears to download the file, but no file is saved in the /home/zaurus/Corsair/shows directory.

http://abcnews.go.com/xmldata/xmlPodcast?id=868748
mistermix
icruise: I was able to open the files you posted, also.

jagkra: I was not able to replicate your first issue (corsair quits on refresh). If you could post or message me your entire feeds.opml file, I might be able to replicate it.

I was able to replicate your second issue - the enclosure in that RSS feed has a "?" in the file name. I will post a fix when I figure out how to fix it.
icruise
I can't seem to get it to load these two feeds:

http://arstechnica.com/etc/rdf/ars.rdf

http://macslash.org/macslash.rdf

I also wish that you could open a particular news item by selecting it with the stylus. As it is now, tapping on it once will just select it and double-tapping doesn't seem to have any effect. I get a "connecting to" message at the bottom of the screen and the item's icon changes to an "audio" icon, but nothing happens. In order to open the item I have to press enter on the keyboard or press the tiny little "information" button on the left-hand side of the screen.

I'm also getting the "quit on refresh" problem.
mistermix
icruise: The mac site worked for me after a 2nd try. ArsTechnica is a definite problem - looks like it may be the number of redirects it uses. If you want a quick work-around, use this URL instead:

http://feeds.feedburner.com/arstechnica/BAaf

jagkra sent me an opml file that exits on reload. That should help me debug this beast.

Thanks to both of you.
mistermix
Here is a new corsair build that should address all bugs reported to-date on this thread. Specifically:

1. Redirects should work. The arstechnica site, for example, works.

2. The crash-on-refresh bug should be fixed.

3. Podcasts with "?" in them should be saved correctly. The nightline podcast, for example, works.

4. Double-tapping on a news item that is a text post, not a podcast, will now display the text of that item rather than trying to download and play it.

Thanks for testing, and please post to this thread if you find bugs. If you find a bug with a particular feed, please post the feed URL.
witzgall
Hi; Just downlaoded, look sgreat. I am new to rss readers, but I have had a blog for a few years. It supports atom, will your software read this format?

Chris

QUOTE(mistermix @ Oct 4 2005, 07:52 PM)
Here is a new corsair build that should address all bugs reported to-date on this thread.  Specifically:

1.  Redirects should work.  The arstechnica site, for example, works.

2.  The crash-on-refresh bug should be fixed.

3.  Podcasts with "?" in them should be saved correctly.  The nightline podcast, for example, works.

4.  Double-tapping on a news item that is a text post, not a podcast, will now display the text of that item rather than trying to download and play it.

Thanks for testing, and please post to this thread if you find bugs.  If you find a bug with a particular feed, please post the feed URL.
*
Ripley
Misterix, is your patch in the oe repository? Or did you sent it to tiny ogre? It would be nice to have also a release for QT (opie).
mistermix
I've been emailing all changes to tiny ogre. He said he was going to incorporate them in his next release.

QUOTE(Ripley @ Oct 4 2005, 05:40 PM)
Misterix, is your patch in the oe repository? Or did you sent it to tiny ogre? It would be nice to have also a release for QT (opie).
*
icruise
Great job! This makes the program quite a bit more usable. I think the main thing we need now is the ability to sort feeds in folders.
Hrw
We also need source to be available to fetch so anyone can build it.

Currently OE has recipe for corsair 0.2.0 but sources are fetched from CVS (which is slow on sf.net).
icruise
Any more updates on this program?
mistermix
Nothing has been posted on Sourceforge since 9/10, and I haven't heard from the author about my last set of changes, so I don't know what's going on with this project.
Hrw
mistermix: could you provide your patches? I will update OE copy then.
mistermix
Here is a gzip'd file of all of my patches. Let me know if you want it in a different format.
Hrw
Best format (not only for me) is unified diff (cvs diff -u). I applied your patch to 0.2.0 source and created unified version.

Will check does it apply with all OE patches to corsair (there is one which do something OPIE related to it)
bam
nothing more on updates? perhaps commandline interface, like updating feeds, option to autodownload the whole articles etc...would be great!
tombraider
None of these corsair packages will install on my Cacko 1.23 C1000. I get an error message from the package installer:
QUOTE
The filename of this package includes character (sic) this application can't handle.  Please change the filename and retry install.


How do I get around this??

Edit: Nevermind, I just didn't place the ipk in the Install_Files folder.
Trying the software out now.

Edit2:
Works great on my C1000. rolleyes.gif
nilch
Another good feature would be to have a font increase/decrease for better readability...
nilch
While I find the Corsair to be extremely useful for my recent RSS aggregation on my Zaurus - I still cant uinderstand why I cannot see the full feed. I seem to get only partial feeds for most of my RSS feeds (when they do provide a Full feed) ?

Any ideas, or am I missing something ?
dwagelaar
I've patched up the corsair 0.2.4 source code to compile against Qtopia 1.5.0, which means it should run on all zauruses. I've tested it on a Zaurus SL-C860 with the Cacko 1.22 ROM. The current ldd output looks like this:
CODE
$ ldd /opt/QtPalmtop/bin/corsair
       libqte.so.2 => /home/QtPalmtop/lib/libqte.so.2 (0x40022000)
       libqpe.so.1 => /home/QtPalmtop/lib/libqpe.so.1 (0x40456000)
       libm.so.6 => /lib/libm.so.6 (0x405df000)
       libc.so.6 => /lib/libc.so.6 (0x4060e000)
       libjpeg.so.62 => /home/QtPalmtop/lib/libjpeg.so.62 (0x40729000)
       libdl.so.2 => /lib/libdl.so.2 (0x4074f000)
       libcrypt.so.1 => /lib/libcrypt.so.1 (0x4075a000)
       /lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0x40000000)

The patch I attached should be applied after the "corsair_patches.cdiff.gz" has been applied to the CVS sourcecode of corsair. I'll come up with an ipk soon wink.gif
dwagelaar
Added Corsair project to elsix.org:
http://www.elsix.org/index.php?w=project&p=corsair

Direct download is available from my feed:
Sharp ROM
Cacko ROM 1.22
tiny ogre
Contrary to popular belief, I'm still alive!

I added most of mistermix's patch to the main source and put out a new binary release, labelled 0.2.5, along with a source tarball release so that there will be an "official" reference point other than CVS. However, it does NOT have the change to use "kino2" as the default player, as the old option is still correct for the PMA. This is something that would be settable via preferences if only there were a preferences dialog. All of his other changes are now in the main source.

I also did not integrate the QPE 1.5 patch, as that's not what I'm using to build it, and it would fail in my environment as given.

But hopefully everything's at least closer together now than it was.

There's one other change: if an enclosure has a video mime-type, then Corsair will attempt to launch a video player instead of an audio player. This works for a very limited subset of video podcasts. In fact I don't even have any public ones that have video that works on the PMA, but it was requested by someone who had a test feed set up, and it was easy enough to do. This again would benefit greatly from a preferences dialog.

If it turns out I'm really not dead, a preferences dialog is obviously the next task that needs doing the most. But no guarantees. That would qualify for a 0.3.0 release. Submissions from 3rd parties are welcome!

If you need to contact me, please use "corsair at rumsey dot org" as my address.
Hrw
corsair 0.2.5 is available in OpenZaurus :D
tiny ogre
I just checked in a rudimentary preferences dialog to CVS, only has UI for setting the audio player and video player, nothing else, but that was the main thing holding up a unified PMA/Zaurus release it seems. No new release yet, I'm going to try to put together a Downloads dialog (combining both already-downloaded and pending downloads, all in one list, so you can easily see what's available to play or soon will be) in the next week or two and call it 0.3.0.

But as the last ~10 months have clearly demonstrated, I am not a reliable maintainer of this project, so no promises smile.gif
eji
What's the progress on Corsair? I've since put Keroplayer and dmBlogger to the side and re-installed Kino in order to use Corsair exclusively, but I'd love a few more preferences such as auto expire, zPlayer/Sharp Music Player support, and groups. This is such a good start... it would be a shame to see Corsair simply languish.
tiny ogre
I released an updated version (0.2.6) today. It has the preferences dialog I mentioned months ago. The only preferences right now are what programs to use for playing audio and video. It also has a bug fix for redirect handling (If some feeds or their file downloads weren't working for you, this may have been the cause). That's it, a pretty small update, but the preferences dialog should make life a little easier for Zaurus users.

The default players are still set up for the PMA, not the Zaurus.

I'm obviously not spending a lot of time working on this, but patches from others for anything you'd like to add are always welcome.

Downloads are here
brashley46
QUOTE(tiny ogre @ Nov 25 2006, 07:32 PM)
I released an updated version (0.2.6) today.  It has the preferences dialog I mentioned months ago.  The only preferences right now are what programs to use for playing audio and video.  It also has a bug fix for redirect handling (If some feeds or their file downloads weren't working for you, this may have been the cause).  That's it, a pretty small update, but the preferences dialog should make life a little easier for Zaurus users.

The default players are still set up for the PMA, not the Zaurus.

I'm obviously not spending a lot of time working on this, but patches from others for anything you'd like to add are always welcome.

Downloads are here
*

Well, it works as well as 0.2.5 on my 860; I'll have to find the prefs dialogue.

cool.gif
tiny ogre
QUOTE(brashley46 @ Nov 25 2006, 09:13 PM)
Well, it works as well as 0.2.5 on my 860; I'll have to find the prefs dialogue.


It's in the View menu. The menus are in the topmost button on the sidebar.
brashley46
QUOTE(tiny ogre @ Nov 26 2006, 05:22 AM)
QUOTE(brashley46 @ Nov 25 2006, 09:13 PM)
Well, it works as well as 0.2.5 on my 860; I'll have to find the prefs dialogue.


It's in the View menu. The menus are in the topmost button on the sidebar.
*


Got it, thanks, and enabled "Music Player" and "Kino2"; but I'm not subscribed to any podcasts ... just rss newsfeeds like LabourStart. Now I'll have to go find some, and see if they work this way!
eji
"corsair: error while loading shared libraries: libqtopia.so.1: cannot load shared object file: No such file or directory"

I'm on a 6000 running the stock ROM (Qtopia 1.5.4). Corsair 0.2.4-1 worked fine.

Anyone got any suggestions?
tiny ogre
QUOTE(eji @ Nov 27 2006, 12:58 AM)
"corsair: error while loading shared libraries: libqtopia.so.1: cannot load shared object file: No such file or directory"

I'm on a 6000 running the stock ROM (Qtopia 1.5.4). Corsair 0.2.4-1 worked fine.

Anyone got any suggestions?
*


Corsair 0.2.4-1 is not an official release, did you get a version from a different location than mine? Mine's the "official" version, but I'm really building it for the PMA400, not Zauruses at all. It's just a happy coincidence that it works for many Zaurus users.

I'd be happy to provide alternate builds if I knew how to build them or if someone else wanted to send them to me.
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2014 Invision Power Services, Inc.