Any (free) Hacker News datasets around?

Question

As the topic says, I'm looking for datasets containing the data from Hacker News, specifically comments. I've found some on BigQuery that are not very well updated (nor free/downloadable), and via other sources but also not updated.Mostly looking for data for last three years, but having the data from the beginning > today would obviously be the best, but really hard to find.

karimf · Accepted Answer

I believe the one from big query is updated?
I just tried using this query
SELECT * FROM `bigquery-public-data.hacker_news.full` WHERE type='comment' ORDER BY timestamp desc LIMIT 100
It returns comments as recent as August 2, 2021

krapp · Answer

If you have time, you can get everything from the API. Get the latest ID, iterate down and download the comments.

cpach · Answer

Maybe try Algoliahttps://hn.algolia.com/api

Any (free) Hacker News datasets around?

I believe the one from big query is updated?I just tried using this querySELECT * FROM `bigquery-public-data.hacker_news.full` WHERE type='comment' ORDER BY timestamp desc LIMIT 100It returns comments as recent as August 2, 2021

If you have time, you can get everything from the API. Get the latest ID, iterate down and download the comments.

Maybe try Algoliahttps://hn.algolia.com/api

I believe the one from big query is updated?
I just tried using this query
SELECT * FROM `bigquery-public-data.hacker_news.full` WHERE type='comment' ORDER BY timestamp desc LIMIT 100
It returns comments as recent as August 2, 2021

Maybe try Algolia
https://hn.algolia.com/api