• idunnololzM
    link
    fedilink
    35 days ago

    Hmm I double checked how trustworthy their factualness ratings are and it seems ok and generally not controversial.

    On the other hand it looks like they are insanely restrictive about their API, requesting a $10/month fee and only giving a API limit of 50 requests/month. There are a few scrapers that I’ve found but it looks like if I wanted to add this feature realistically I would need to (1) use a scraper to compile all their data into a database (2) host the database myself and (3) create my own API against this database. This is a lot of maintenance work, the biggest by far is maintaining the scraper. It’s also a bit concerning how legit this would be since I’d imagine they would not be happy if they found out I was essentially scraping all their data and serving it myself.

    Due to all of this I don’t think I will add this feature unless I found a better way to access their data that wasn’t as sketchy.

    • Cris
      link
      fedilink
      English
      25 days ago

      Gotcha. Is the api different for the overall rating? I wonder how the bot and the other app are doing it

      • idunnololzM
        link
        fedilink
        2
        edit-2
        5 days ago

        I’m guessing all of them scraped the website and they are all using the data they scraped. I’ve done a lot of projects like this before. The first couple of years its easy. But it can get annoying over time because the website can change, they can add anti-scraping measures, etc and it becomes a whole cat and mouse game. I’ve been forced to just remove features in the past because I didn’t want to play that game anymore and it has always sucked.