This is my hobby project I've been working on. At the moment there are 15231991 pages in English wikipedia, and a whopping 671872114 links between them.
This project uses custom-built Rust parser to parse through the data (in 15 minutes!) and Google BigQuery to find the shortest path between two pages using a rather simple breadth-first search query.
2 comments
[ 3.7 ms ] story [ 11.2 ms ] threadThis is my hobby project I've been working on. At the moment there are 15231991 pages in English wikipedia, and a whopping 671872114 links between them.
This project uses custom-built Rust parser to parse through the data (in 15 minutes!) and Google BigQuery to find the shortest path between two pages using a rather simple breadth-first search query.
Let me know what you think!