const randAlphaStr = length =>
String.fromCharCode(
...Array.from({ length }, () => 97 + Math.floor(Math.random() * 26))
);
const pitRustAgainstRandomFourCharAlphaStrings = async sampleSize => {
const rustScore = await getPrediction("rust");
let rustLosses = 0;
for (let i = 0; i < sampleSize; i++) {
if ((await getPrediction(randAlphaStr(4))) > rustScore) {
rustLosses++;
}
}
console.log(`rust lost ${rustLosses} times out of ${sampleSize}`);
};
pitRustAgainstRandomFourCharAlphaStrings(100000);
Result:
rust lost 55469 times out of 100000
I'd say rust fairs worse than the average random four character string with the letters a-z. That should tell you something about the usefulness of this model.
"Hacker-AI uses a brain.js feed-forward neural network machine learning model that has been trained with the below dataset that contains all stories and comments between 2006 and 2017...The current algorithm has been tested with approx. 10.000 posts. It has been able to predict 60% of the cases correctly."
Seems to be affected by heavily by capitalization in a surprising way. "Show HN: AI OpTiMiZeR ToOl" fares 6% better than same written in non-braindamaged way, and fares even worse when compared to all caps.
> The title is transformed it into an array of numbers between 0 and 1 (each character is a number) and this data is fed (along with the number of points) to the neural network.
This sounds strange. But after looking at the authors bio, it isn't strange any more. This has less to do with AI and more with cheap growth hacking.
Converting text to numbers via individual characters destroys any semantic meaning to the input. Which is why no advanced NLP tools will do such a thing. Basically, what they describe takes whatever meaning is in the title and throws it in a shredder.
It's also strange because what they've trained is essentially a recommender system. However, at inference time you're not trying to rank 2 different articles, but the same article with 2 different titles, which I guess you could do, but I'm not sure how well this correlates to your actual ranking on HN.
I guess something more interesting would be to take into account the current front page and see how your article would rank against those, or something along these lines.
44 comments
[ 135 ms ] story [ 1691 ms ] threadCompetition time - Can anyone come up with a title better than "Rust"?
Edit: I've beaten "Rust" by putting in the title " ". Can anyone beat that?! AI clearly has worked out the less substance the better!
Edit: looks like it's maybe a tie, instead. B wins in case of a tie.
Title B: Show HN: New grep tool written in PHP (7% better)
Hmm.
FWIW, Python fares worse than Rust, C++ beats PHP by 2%.
NB! I'm not arguing for or against PHP, and don't want to take this thread on THAT particular tangent!
Title B: Show HN: New grep tool written in Garbage (1% better)
I guess Python is 1% worse than garbage. Lol
TITLE B: How you can earn $46k/M selling Montessori toys
Tried it for on of our ProdcutByte products
That seems rather old data for a tech community?
"Hacker-AI uses a brain.js feed-forward neural network machine learning model that has been trained with the below dataset that contains all stories and comments between 2006 and 2017...The current algorithm has been tested with approx. 10.000 posts. It has been able to predict 60% of the cases correctly."
This sounds strange. But after looking at the authors bio, it isn't strange any more. This has less to do with AI and more with cheap growth hacking.
> Title A: kdjfs;dfisd;diofuosd
> Title B: sdlkn nmkd kljdsa;'[ (10% better)
> The winner is title B: sdlkn nmkd kljdsa;'[
I guess something more interesting would be to take into account the current front page and see how your article would rank against those, or something along these lines.
In any case, neat idea.
B: rust
=> B is 66% better.
Damn it, I should have used rust! Anyways, great project. Bookmarked!
1: Shameless self-promotion: https://rugpullindex.com
B: Rust
=> B is 71% better.
Rust is unstoppable, clearly.
A: We cured corona virus
B: rust
=> rust 64% betteer