Roslow

Is it just me, or does it seem like Rojo has been getting a little slower on the feed updates? It seems like they’re running into scalability issues as more people add feeds for it to fetch.

8 Comments

  1. Dan
    Posted December 5, 2005 at 4:31 pm | Permalink

    What do you mean slow refreashing or slow to parse.

  2. Posted December 5, 2005 at 7:34 pm | Permalink

    It seems slow on them gathering the feeds into their system; sometimes it takes quite a while for it to pull in new posts and comments to its system.

  3. Dan
    Posted December 5, 2005 at 10:29 pm | Permalink

    They probably have an algorythm similar to feedlounge.

    They parse feeds that are updated more frequently more and so on. They also most likely set the 30 minute minimum check because they don’t want to be blocked by some of the larger sites that block for checking more then once every thirty minutes.

  4. Posted December 5, 2005 at 11:02 pm | Permalink

    Ya, that’s what I figured, but I don’t think any of them need to wait 30 minutes. The big sites may only allow one check per 30 minutes, but I doubt that they permanently ban your address for checking more often, so you could just have it keep checking even if it only gets new stuff less frequently from some sites who implement this kind of restriction.

    This is one reason why I am still planning to do my own aggregator, because then I will be able to control at a per-feed level how often I want it to be checked.

  5. Dan
    Posted December 6, 2005 at 5:24 pm | Permalink

    Actually I know for certain it is because feedlounge went through the same problems with Slashdot and other sites in the begining.

    I’ll look for it.

    You’re spending more time talking about this vaporware rather then doing it. Why don’t you just work on an existing opensource project?

  6. Dan
    Posted December 6, 2005 at 5:27 pm | Permalink
  7. Dan
    Posted December 6, 2005 at 5:31 pm | Permalink

    Or you could have just checkd the faqs at rojo since it only took me a minute to find this.

    How frequently will Rojo update? (top)
    Rojo updates most feeds on an hourly basis, checking to see which of your feeds have been updated or changed, and then adding the new stories into your categories.

  8. Posted December 6, 2005 at 6:08 pm | Permalink

    Ya, I didn’t want to take the time to look into it.

    Slashdot is pretty lame for banning an IP if it checks the feed more than once every 30 minutes. This is what caching is for; maybe they don’t know how to implement it properly.

    As for my future project, I’m not spending much time at all talking about it. I’m not aware of any open source feed aggregator projects, but then again, I haven’t really looked much either. One of the reasons why I’d rather just do my own is that I enjoy doing it myself, for the learning and experience, and the satisfaction of having it work exactly the way I want it to. It will take a while to do, once I even start on it, but that doesn’t matter too much to me, since I haven’t promised that I’d have it done by any certain date.

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*