246 comments

[ 1.3 ms ] story [ 245 ms ] thread
What on earth.. is this captcha some kind of joke?

https://ibb.co/3yW9mjj

I'm a human but it's not clear what the "challenge" even is that needs to be completed.

And after you get it wrong, it doesn't kick you out, it just flashes a toast message like "User failed captcha".

Twilight zone material.

Write the alphanumerics connected by a green line, i.e. connect (connected) the dots. I dunno, I immediately recognised it .
I swear I tried that.. guess I'm a bot ^^
What is the final character? It looks like a backwards 7 or Cyrillic G.
It’s just 7. How is it backwards?
Careful, don't teach the bots. Just let them fail to recognize. There is literally a 7 in the image on the keyboard proving it's not backwards.
(comment deleted)
Maybe ChatGPT with an image recognition plugin could help us solve these
Agreed, this is a terrible captcha because O and 0 look nearly identical but it fails you if you mix up these two.
I just hit accept with a blank input and it accepted it
Took about 15 seconds to download the app and display the first few posts. Come back in another 2 years.
I don't know why but this somehow taxes my CPU more than the official Reddit site, which is kind of impressive in a way.

The theme itself is a good Reddit replica, but I don't think IPFS has the necessary performance to run apps like these. Maybe it can live become a Lemmy frontend for the FOSS/fediverse crowd?

The number of third party domains this site needs to hit to even load any posts on the front page is insane. I'm looking at a list of domains like "etherscan", ipfs gateways, pokt... all kinds of shady sounding bullshit and it isn't at all clear to me what I would need to whitelist to get this site to work: http://0x0.st/Hbkj.jpg

Yes I know this is "my fault" for being a weirdo who doesn't blindly let his browser hit any server a website pleases. But I use this to judge the quality of a website, the care and professionalism that was put into it. This plebbit site is awful by this metric even compared to new reddit; with new reddit merely whitelisting *.reddit.com is sufficient to view a list of posts, and whitelisting 3 more domains (all clearly reddit-affiliated: redd.it, redditmedia.com and redditstatic.com) is enough to make the site behave as it should.

its just a bunch of IPFS and ETH gateways. I haven't tried it myself, but I think there's a desktop application you can install that connects to IPFS natively. I don't know if they're running their own ETH node, but probably not.
I use noscript and while normally I’d agree with you about the number of reqs to 3rd party domains being an inverse indicator of quality, I think in this case it just means the client application is marshalling its own connections to broader p2p system without a fancy experience api layer.
Welcome to dApps where everything requires centralized gateways or you must run half a dozen of your own full nodes with 1TB storage each.
plebbit doesn't require you to sync an entire ledger, it uses content addressing (IPFS), which lets you only download and seed the content you use, not the entire network. A plebbit "full node" is just an IPFS node (similar to a bittorrent client), it takes no space and has no sync time.
the frontend is open source, people can use it for anything they want, even competing projects.
Is there any settings to not make it look like new reddit? If I was building a new site I wouldn't copy the godawful empty space design they forced on everyone
We have an imageboard interface https://plebchan.netlify.app/ and currently working on an old.reddit interface.

Other interfaces that are planned are stackexchange, discourse and vbulletin.

The protocol is completely open and the code open source. Anyone can make any number of interoperable interfaces.

Thanks for the info! I'm intrigued by the different interfaces for the same content. I'll definitely keep an eye on this when reddit dies in a couple weeks!
So does this mean each subreddit creates and hosts their own entire “Reddit clone”?
Each community owner must run a node 24/7 to seed his own community's content via IPFS. Similar to how you need to seed a torrent you client.

There's a GUI client so it's very easy, you just double click and leave it open.

It's also possible for centralized services to run communities for people, so it's technically possible to run a community without having to have any device run 24/7 yourself.

friendly reminder that IPFS is not usable anonymously and it will reveal your IP to everyone
The content you’ve linked really does a good job at showing how completely decentralized P2P social media is a terrible, terrible idea.
Yep, it may be technically of interest, but devoid of any modicum of social nuance or sophistication.
Yes because Reddit gets its sophistication from being centralized and VC owned?

The quality of Reddit is created by the users. If they used a P2P platform the content would be of high quality.

Decentralized does not mean there's no moderation. 4chan is centralized but the content can be... We don't need big companies to help us do quality moderation. Quite the opposite.

P2P social media is a fantastic idea.

Please don't snarkily dismiss someone's work. If you want to contribute constructively, there are plenty of other ways to bring this point.

https://news.ycombinator.com/newsguidelines.html

One of the first posts I saw was the N word over and over
That's no excuse for posting bad comments yourself.

A big internet forum like HN gets tons of crap comments. Most eventually get moderated, but not all; and even the ones that get moderated take time before we see them.

It's weird to use the name "plebbit" considering that's the derogatory term for Reddit used by 4chan folk. It's like begging for this to be a dumping ground for some of the worst human behaviors.

Does the decentralized nature mean that illegal content can't be easily be removed?

> It's weird to use the name "plebbit" considering that's the derogatory term for Reddit used by 4chan folk. It's like begging for this to be a dumping ground for some of the worst human behaviors.

i think thats the obvious intention. Just scroll down the page to see what the user base is.

And that makes it nothing more of a joke website to me even if it's impressive under the hood
Impressive? It didn't even finish loading for me lol.
You'll also notice that the logo makes the face from the "NPC" memes that would have still been popular among the 4chan "politically incorrect" crowd right around the time this project was allegedly started. Sadly, for enterprising edgelords, Elon has usurped them all by turning Twitter itself into the ultimate "alt-tech" app. Like, seriously, unless you want to share illegal pornography, why not just share your spicey maymays on Twitter where they'll get more reach? Impressive amount of follow through regardless.

https://knowyourmeme.com/memes/angry-npc-wojak

Well, theyve been working on it for 2 years, you expect them to be normies?
I recommend the parent and all sibling commentators carefully revaluate their biases in light of this project as a singular topic. It will greatly benefit the understanding of context (somewhat unintuitively -- the terminology is adopted as lingua franca from a reactionary anonymous amalgam, not necessarily tied to the original intent or event).
If the initial reaction from multiple people is “this is a name that has some pretty bad implications” then maybe, just maybe it’s the name that’s the problem, not everyone reacting to it.

This would have easily been avoided by… choosing a name that doesn’t have such a storied past.

the name will set a vibe that attracts the specific crowd. since its a new site that initial user base will set the tone of what the web site will shape into.
Not compatible with the fediverse? I’ll stay on Lemmy.
The fediverse is federated (it's in the name). This is distributed (P2P). They're fundamentally different concepts in the underlying protocol so compatibility is a bit odd to think about here.

There are certainly overlaps in the two concepts and certain parts of them can be compatible to a small extent: a bunch of people have compared Bluesky Social's AT protocol to SSB despite the former being federated & the latter being p2p. But similarities aside they can't really be compatible at protocol level.

Is it true that Lemmy censors casual profanity like "bitch"? I first heard of Lemmy a few days ago, in the context of somebody dismissing it because it allegedly performs such censorship.
there is a regex filter in the code to censor many words
The default instance is worse than reddit for censorship.
It does. This doesn't make the concept doomed, though, being on the Fediverse it's already interoperable with Kbin, a hybrid microblogging and link aggregation platform.

A capable person with different views could fork Lemmy while keeping compatibility, and that has happened many times with other Fediverse software.

Visually nice...

Content is terrible...

Speed is atrocious...

Alas, I don't think it's yet ready for primetime. Is it fixable in a week?

>Alas, I don't think it's yet ready for primetime. Is it fixable in a week?

We are 4 devs working full time on it. In my estimate it should be pretty smooth in around 1 year. We should also have an old.reddit interface as well for people who hate the new interface.

Who pays for your time? Or is this 3 years of free work?
I'm paying for it from my savings, around $300k so far
Nice going! How can I get in touch with you?
twitter: estebanabaroa tg: estebanabaroa discord: estebanabaroa#2853
You spent that much on this so far? How do you plan to get a return?
I don't, it's a donation, not a for profit project.
4 devs full time! How’d you swing that?
Technically this project is very impressive...

But the user experience is terrible.

I think to have any success, you need to let the p2p features take a backseat, and build a lot of centralised content moderation tooling. You can plug the p2p bit into the centralized bit with a config URL for "List of allowed moderators" and have it default to a bunch of trusted people, who effectively have whitelist/blacklist/supervote abilities.

Then you need to populate it with a bunch of good content to start off with.

Congrats - seems pretty functional from a technical perspective
People are arguing about the contents, which is kind of shallow, it can be always managed in some way later. I’m more interested in the technicality, what’s the protocol, the architecture, how file are saved and served, encrypted? How about the minimum X to run the service, is it P2P as in all clients serve or only select few nodes? Who manages and operates these nodes? Is it a honeypot? Among others.

Regardless, It’s always good to see new concepts or alternatives sites, just like old days with forums.

high level whitepaper: https://github.com/plebbit/whitepaper/discussions/2

the protocol is a light protocol over IPFS/IPNS/Libp2p Gossipsub

IPFS files (JSON/base64): https://github.com/plebbit/plebbit-js#schema Gossipsub protocol messages (CBOR): https://github.com/plebbit/plebbit-js#pubsub-message-types

There's also a FAQ https://github.com/plebbit/whitepaper/blob/master/FAQ.md

There is a disdain for federated protocols but I hardly see how this is any different except that there are no explicit federation features.

The "subplebbit" owner acts like the operator of a Mastodon or Matrix instance except as mentioned above, those were designed to aggregate data across instances.

The fundamental problem with these decentralised platforms is that they want to get rid of the human element but if you just let anyone get away with anything and everyone rehosts everyone else's data unconditionally, then you get something like zeronet which has its own Reddit clone. The problem with zeronet is that people advertise their illegal porn on your supposedly "family friendly" Reddit clone and your users involuntarily download it and make themselves criminally liable. Whether something should be legal or not is a philosophical question, someone has to make a decision and then enforce it. Any platform where users are allowed to upload arbitrary information requires moderation. There is no way around this. The only benefit of a decentralized app is that you can have smaller self hosted communities.

I spent a lot of time evaluating the technical viability of decentralised apps and honestly you should avoid it even if your use case requires it.

>The "subplebbit" owner acts like the operator of a Mastodon or Matrix instance

- Mastodon and lemmy instances can delete your account/community data (they own your data), on plebbit you own your data, it's on your device and you seed it P2P, community owners cant delete it

- Mastodon and lemmy instances can block you from accessing and interacting with other instances through their client, which forces you to use multiple clients to interact with all instances you want, on plebbit, the client accesses all content directly and p2p, community owners can't block you from accessing any content. You only have to use a single client.

- Mastodon and lemmy instances require a domain name, a static, public HTTP endpoint, an SSL certificate, DDOS protection to run. All which are complicated to set up, cost money, sometimes require KYC, sometimes require the command line and linux. Your server, domain, ssl and ddos protection provider are intermediaries that delete/block your account.

Whereas plebbit is a GUI executable like a bittorrent client, you download it, open it, that's it, you're done. No payments, no kyc, no command line, no config, no intermediaries that can shut down your account.

Ultimately a young site lives and dies on community. So I understand why. The average person looking for a site to talk on isn't concerned about the tech stack underneath. just that the experience is smooth.
Hate to be that guy, but why opt for the new reddit look? This is already coming out of the gate on the wrong foot. The UI is slow and has so much unused white space.
Not a fan of their UI being absolutely covered in NFT/.eth links either.
Old reddit, while nice and textual is server side rendered. If you are dealing with P2P not fetching everything in one go (and thus suffering some async performance issues) is better than trying to render it all at once.

That's part of the "why of new.reddit"... which makes sense for some aspects of its infrastructure. Yes, I prefer old.reddit because it renders everything at once and the layout is simpler. But if you're waiting on the network more than the CPU, new.reddit style is probably better.

The UI being slow is because loading stuff from cloudflare-ipfs.com is slow. Trying to get it all at once for a 30 card rendering would be even slower if you're waiting for ipfs.

Old reddit had a compact design that filled the page. New reddit and plebbit both have huge margins on the side, tons of white space between boxes, etc. It's got nothing to do with server-side rendering.
Musk claims the only solution to bots in 2023 is paid accounts.

I kinda agree with him. There is no captcha that's going to keep out determined spammers. Even reddit is filled with bots.

You either try to eliminate bots through paid accounts, real ID verification... Or you filter based on quality of content (ie. bots are allowed to post, as long as what they say and do is indistinguishable from a human - like reddit does).

Whats the anti-spam plan?

>Whats the anti-spam plan?

the community owner must configure some challenge exchange between his node and the users publishing to his node. the challenge is completely arbitrary, it can be a whitelist, a password, a super complex interactive game, sending a picture of your passport, account age, minimum karma, a combination of all these things, etc. Since it is arbitrary, it will evolve with time. Any method (already invented or invented in the future) that centralized platforms use to filter AI spam can also be used, but over P2P.

> Whats the anti-spam plan?

User moderation in focused spaces!

Its the same reason Discord/Telegram kind of works, the same reason small niche subreddits (and Hacker News) are still OK, the same reason dedicated game servers are so much nicer than public matchmaking in video games... They have a hierarchy of users who are motivated and empowered to police their own reasonably sized niche space.

Twitter can't do this, but maybe Twitter should not exist as it does now.

Reddit the company wouldn't really like this either, as they would have rather have mainstream mega-subreddits over collectively smaller niche subs.

> User moderation in focused spaces!

Remember the bots can make their own spaces too... And then lure real users in with a bunch of chatgpt-like and/or stolen content...

What's stopping a determined spammer paying for accounts?
> What's stopping a determined spammer paying for accounts?

Paid accounts adds a significant overhead to the spamming.

Spammers just don't spam for the sake of it, they want to sell people something, legal or not.

It's one thing to buy millions of spam accounts for $100 on the dark web. It's another to have to spend $5 bucks a month per account on millions of accounts...

For nation-state actors looking to spread disinformation, paid accounts are effectively free.
> For nation-state actors looking to spread disinformation, paid accounts are effectively free.

Depending on your definition of "free", then it becomes a government agency's problem, not the platforms.

As an individual, $5/month for a social media account is expensive and alienating. The vast majority of real people are already priced out.

For a business, a shill account can be one of the cheapest marketing options.

A determined spammer wouldn't be above buying stolen cc numbers off the dark Web.
> A determined spammer wouldn't be above buying stolen cc numbers off the dark Web.

Good, that would eliminate 99.99% of the spammers.

Good enough for any social media.

The potential bank fraud and wire fraud federal charges are just the cherry on top of the ridiculous overhead of your imaginary spam operation.

Can you easily pay for accounts anonymously?
I think explicit & transitive trust is a strategy worth exploring. If you trust accounts made by people that you know personally, and you transitively trust the people that they trust (say... five hops). That's going to be a significant portion of humanity.

If you start getting a little spam, you explicitly revoke trust in the spammers. If you get a lot of spam, revoke trust in whoever you trusted that trusted the spammers, etc. A little bit of social graph hygiene ought to go a long way against spam, so long as we're trusting people and not platforms. We're practiced at one of those and not the other.

I think a solution to bot accounts could be a referal system. Everyone who signs up needs to be referred by another person. If the new user has negative impact on the platform, all parent users on the referal chain lose some sort of trust.

Users can set a "trust" threshold and all content they see is filtered through that lens. It's like an automatic twitter block based on an algorithm.

Also people would ask the people they refer to the platform to please not do bad things so they can preserve their "trust" rating.

So do you get a captcha every time you vote? that's quite annoying.
soon we will add the ability for the community owners to let users bypass challenges if they have X amount of karma or account age.
You should look into POW captchas like mcaptcha or powcaptcha. It's a far better user experience.
the challenge exchange between the authors and community owners are arbitrary, they can be anything the community owner can code and that the author client understands, so POW is possible, but I'm not sure it would stop spam properly, a server can do a lot POW for cheap. Maybe combined with another challenge.
Already vandalized through shitty trollish posts. Sadly, in this Internet and era you can't build a healthy community without some form of moderation.
When was it ever true that public discussion didn't require moderation? We live alongside a pile of mush brained, mouth breathing dullards whose single and only goal in life is for somebody to vote up their latest brain fart and be told what to think.

Largely we excluded these people from conversation with social cues and sold them back their prejudices via red-top newspapers, which mostly kept their brain farts and prejudices suppressed.

For better or worse, you can't do that with the internet. Facebook and twitter seem hell bent on not only encouraging their appalling behaviour but amplifying it.

The only way to stay away from them is to stay ahead of them and stay away from any medium these idiots think is "their place".

Unfortunately, those people vote.
They do vote and they should vote. That to me is quite different from deliberately inflaming them to other actions.

edit: what I mean by that is that facebook, twitter and reddit and 4chan should be held directly responsible for the violence they foster. "we're just a communication mechanism" doesn't cut it anymore. Their promotion algorithms are very different from being a telephone company

4chan is a healthy community. No karma, no "flagged" posts and none of the bullshit you see here. HN is objetively inferior in every measurable way, and I've been using both for >10 years.
Every time I see social media recreated in a decentralised fashion I realise why the successful ones are centralised. The loading times of this are dreadful and I don't see how you'll be able to solve that problem when you're relying on P2P.

In any case, it sounds like we'll be getting many new Reddit clones so I may as well plug what I've built recently: a Reddit alternative API that is free. Check it out if you're a dev that is being caught out by the Reddit pricing changes[1].

1 - https://api.reddiw.com

> The loading times of this are dreadful and I don't see how you'll be able to solve that problem when you're relying on P2P.

It's easy enough to centralize a caching layer, perhaps through a popular CDN.

Why not a bittorrent style peering mechanism? Popular content will always have pools of people who are consuming it.

I've had an idea in the back of my head for what would make a decentralized video service work, and it plays with the idea of peer driven networks.

So, there a few kinds of people on the network: advertisers (hang in there, I'll explain why), leechers (or consumer), content producers, and seeders.

The prime relationship is between a consumer and a content producer. Every other part of the network is designed to support and benefit their interaction.

First, a content producer creates a piece of content (or steals it, let's be realistic) and publishes it on the network. Attached to the content is a pay-per-view requirement; the producer has elected to require payment to view this content. This money can come from one of two places: first, an advertiser can bid on slots the producer has chosen, second, the consumer can pay the producer directly. The producer doesn't have a choice whether the consumer pays or not, only that payment is required.

Requiring payment for the content is optional, but advisable. You see, the producer has a second order relationship with the seeders. The producer can't possibly feed a million viewers in the first hour. That would be a very difficult task. But what a producer can do is elect to provide a percentage of their required income to seeders. Now there's a financial benefit to seeding a popular video/song. The producer can set their payments to whatever they want. The market may equalize itself.

Finally, we have advertisers, which are the monetary fuel for the fire. Most viewers will tolerate ads and wont want to pay money; so instead they pay time. An advertiser can bid on slots in as precise or general way as they want. If they want to bid on a specific creator's video slots, they can. If they want to bid on a broad category of creators or videos, they can. Etc.

This won't ever be truly decentralized, and there is a whole ecosystem of services external to the network that would be needed for this to function well (payment processors, content collation and moderation -- kind of like how mastodon works, a bidding marketplace for advertisers to interface with the content network, a front end for seeders to select and re-seed, and so on).

I don't have the technical hutzpah to build out something like this. I wish I did. Is there someone out there who wants to be a technical mentor? I'd be game.

--

[edit] There should be more and less granularity in how different parties engage. Some people want to pay 10 bucks a month (Amazon Prime) and forget about the rest. Some people want to pay per view. Advertisers might want to target specific creator's channels or whole segments of created content. Creators might want to be able to never even think about ads and just check a box that says "put an ad in front of every video I upload" and then forget it. Or a creator might want to put ads in videos longer than a certain length. And so on. What I've specified above is loosely conceived and would need a lot of thought to turn it into something useful.

You're just describing YouTube with extra steps.

Decentralization is a meme, the great majority of consumers don't care. People used Morpheus because it was an easy way to watch (free) movies, not because it was decentralized. Now they use Netflix because it's an easy (and relatively cheap) way to watch movies, not because it's centralized.

Besides, Matrix already has p2p chat, IRC has always been a thing, and so on, heck even BitTorrent is technically still alive. (De)centralization is not a feature, nor is it a bug, it's simply irrelevant.

Hopefully, for the consumer it would be no different than YouTube or Netflix. Unless you don't want ads, then you pay your dues.

I have no idea how the experience would vary for the advertisers.

For the producer it should offer more flexibility in how they get paid. This is the major selling point I think. The ability to put out a high effort video -- say you made a full length movie -- and be able to charge theater prices (17.50USD, or close to it) and make sure the ads hit at the appropriate times? It might be worth it for larger creators to swap over.

Wow, as a consumer I am really sold on this model! You tell me I will pay theater prices and get ad interruptions throughout the show? This is fantastic, sign me up. /s
haha this is what im thinking, where is the incentive to actually use it.
I apologize. I guess I miscommunicated something. I mean that a creator can opt to charge what they want and also turn off ads if they choose. Or front load the ads, like theaters do. Really, it is up to the creator how they want to format their content.
Caching is not easy for something like Reddit, where everyone has a personalized feed.
Couldn't you say the same of Mastodon?
Why not just cache sub feeds?
How does your non official API work? Is it using the official API and caching, redirecting to the website, and transforming it into json? I'm just curious.
It basically scrapes reddit.com's HTML. Doesn't use the official API at all (that would defeat the purpose).
Impressive feat! Does reddit have rate limiting, or other hurdles in place similar to the hoops youtube-dl has to jump through? Curious what your thoughts are about maintaining a project like that.
As history has shown, you can only do so much to stop this. If you perfectly mimic the GoogleBot and use google IP ranges by hosting on google cloud, they either take an SEO hit or let you bot them at the end of the day. GoogleBot looks like a DDoS attack a lot of the time too

You can also go the route of looking like a pool of users, then it's just a game of cat and mouse and one providers don't really have time to play

> As history has shown, you can only do so much to stop this.

History has shown you can stop this well enough. Try accessing e.g. instagram; bibliogram attempted this, the project is now discontinued.

This is true in the case of content that doesn't care about SEO. Reddit cares very very much about SEO, so it can never truly block bots.
I've only done some rudimentary rate limiting checks and it doesn't seem like they do. Though I haven't pushed it far (~1000 rpm).

In any case, my plan is to deal with it if it becomes a problem.

That doesn't sound like it's going to be a stable API? I'm not sure there is much you can do though.

Edit: yea after looking at this, it definitely appears to violate the TOS. Also this seems like a huge red flag just begging reddit to shut it down: "Unlike with the Reddit API you do not need to authenticate using OAuth."

IANAL but my understanding is that violating the ToS is only ever a problem if your crawler decides to "sign-in", as that constitutes agreeing to the terms of the ToS.

Further, old.reddit.com doesn't gate any content (even NSFW stuff) behind a sign-in page (at least for now)

> IANAL but my understanding is that violating the ToS is only ever a problem if your crawler decides to "sign-in"

Where on earth would you get that impression?

From the reddit ToS: "To use certain features of our Services, you may be required to create a Reddit account (an “Account”) and provide us with a username, password, and certain other information about yourself as set forth in the Privacy Policy."

NB: "Certain features", that clearly means that features are not gated by sign in, and that the ToS also applies to them.

Also from the Tos: " Except and solely to the extent such a restriction is impermissible under applicable law, you may not, without our written agreement:

license, sell, transfer, assign, distribute, host, or otherwise commercially exploit the Services or Content; modify, prepare derivative works of, disassemble, decompile, or reverse engineer any part of the Services or Content; or access the Services or Content in order to build a similar or competitive website, product, or service, except as permitted under the Reddit API Terms of Use."

And later: "Access, search, or collect data from the Services by any means (automated or otherwise) except as permitted in these Terms or in a separate agreement with Reddit (we conditionally grant permission to crawl the Services in accordance with the parameters set forth in our robots.txt file, but scraping the Services without Reddit’s prior consent is prohibited)"

Question: if someone, using the internet, gains access to your personal computer, but doesn't add anything or delete anything, have they committed a crime?
Yes. CFAA.
Interesting. I just did a quick read. The CFAA protects computer data and is limited to data in which the federal government has a legal interest; data of financial institutions; and perhaps some additional specifically enumerated parties. Its reach is further limited to the theft and subsequent use of data that causes specified types of harm.

So, while it almost certainly would not apply to our personal computers, I think it would probably apply to most commercial companies (provided they were large enough to constitute commercial commerce and provided data was used in a manner explicitly enumerated by the statute)

Edit: it's to its

The interstate commerce clause strikes again. The CFAA has been interpreted in court to apply to all internet connected computers.
My point wasn't that scraping reddit is not a violation of the ToS, it was that you're not able to legally enforce the terms of the ToS (that you have quoted in your reply) on people who haven't agreed/consented to them (which they do by logging in).
Even if I were to agree with your interpretation (and I absolutely do not), this is still plain jane mass copyright infringement. The submitters have given reddit a sublicense to publish their content, not random 3rd parties.
> The submitters have given reddit a sublicense to publish their content, not random 3rd parties.

This is tangential no? Third party reddit apps _already_ republish end user content.

I'm not saying third party apps powered by scraping are not illegal, I'm saying they're _no more_ illegal than those powered by the official reddit API.

How will you deal with the huge onslaught of abuse?
Seems like scraping and providing an alternative API would violate TOS and will receive a takedown notice in due time.
You don't need to agree to TOS to scrape a public website, what they write in it is moot.
Wasn't there a recent SCOTUS case that upheld the need to follow TOS?
(comment deleted)
They can still ban your service, e.g. block your IPs. Sure, you could then play a cat and mouse game with them, but your API clone going down every few days will make it unusable for anyone with a real purpose. The companies that reddit (officially) wants to target, e.g. OpenAI et al., have no problem scraping.
You can just host on Gcloud and report as GoogleBot, good luck with that. There's also plenty of proxy services.

> The companies that reddit (officially) wants to target, e.g. OpenAI et al., have no problem scraping.

Indeed, on their case they just need the datasets anyways

Reddit may not be a public website for long. They push their app and ask for logging in so often, it wouldn’t surprise me if they shut off parts of the site for not logged in users.
True, though that will seriously hurt their SEO.
I don't really find Mastodon that slow.

I do think it's got a lot, lot of sharp edges that need smoothing out before it's really viable. But speed isn't a problem, and it's decentralised.

Mastodon is not P2P/decentralized, it's federated.
> Mastodon is not P2P/decentralized

Mastodon is decentralized, because there is no central server. However, it is not distributed.

(comment deleted)
It is both decentralized and distributed. It's not P2P though, it's a hub-and-spokes architecture with several interconnected (federated) hubs.

Hubs can have decent uptime and thick internet connections. Hubs are relatively few so they replicate state quickly between themselves, and then more locally between spokes when they come online.

Most natural structures are more tree-form, like that.

That just depends on how you define "distributed". If it means "running on multiple machines", then even centralized protocols are distributed, since a part of the computation is running on your computer.

In context of protocols like Mastodon, if the end-user devices aren't primary holders of data, then I don't call it distributed. It's just decentralized. I guess that way, "distributed" necessarily implies peer-to-peer.

Postgres in leader/follower config = centralised Cassandra = distributed Bitcoin = decentralised

The crux comes down to the consensus model for state

Basically the difference between connecting to datacenter-residing apps that internally share data between each other and connecting to 10 random guy's basement PCs.

Everyone who played any P2P multiplayer shooter in their life knows P2P sucks... on the other hand, dedicated server based shooters and MMOs (generally) work great. You don't have to be an IT professional to know this. Similar concepts (speed of light and multiplicative effects of multiple slow connections) apply here.

P2P is only great for uses where latency doesn't matter. See: Torrents.

That's too broad of a generalization. p2p is AWESOME for latency since every server added adds latency. What you are talking about are probably p2p networks with multiple users (based on your shooter reference) and the problem is of home connections and bandwidth since multiple users that all need to connect to everyone doesn't scale.

So for your example: One on ones over p2p are optimal, but p2p matches with more than 8 players are suboptimal (I pulled the number out of my ass it depends on the protocol and usecase)

> I don't really find Mastodon that slow.

Not generally, but many servers. Which results in me avoiding clicking on any links to mastodon because I expect it to be extremely slow.

Which I find frankly ironic because I dread clicking on Twitter links for that same reason.

It takes 10 seconds to load a tweet, and I have to click through the "view in app" nag, to boot.

Using Mastodon servers have been a breath of fresh air in comparison.

I use nitter, the right servers are fast ;)
Too much content is blocked for nitter this days. At least on my experience.
Huh? Like what? Never had that happen.
Some servers/instances maybe are less reliable than others. Same for teddit and invidious.
Ah, well, luckily it’s easy to switch servers. But that’s the issue with Mastodon, you have to view the content on the instance it’s posted on.
I thought Twitter was horribly slow just because of the insane amount of JS and HTML it uses for displaying some simple text. I've always avoided clicking on Twitter links because it's so ridiculously slow.
Nitter page: full page layout with all text loads in about half a second, images load in the next three

https://nitter.it/rauschma

Mastodon page: requires unblocking JavaScript, takes one second just to load the basic layout (without post contents), then takes four to ELEVEN seconds to fully load

https://fosstodon.org/@rauschma

I expected better.

Hmm, compare for https://elk.zone , is it still slow? For me it is almost instant.
With an empty cache, five seconds for the full layout, one further second for images. With a populated cache, four seconds to load everything at once. And also requires unblocking JavaScript for no good reason. Sure, not as bad as twitter.com, but that’s damning with faint praise.
Now use nitter and create your account, login, and tweet something. If you can't, you didn't compare.
Weird. Anecdotal I think. Maybe something with your instance. Mastodon UI is quick and snappy for me. I migrated away from mastodon.social when the influx from Twitter made that server very slow (it has since scaled up significantly).
Both of these load instantly for me.
Is the reddiw code open source? I imagine if your project sees any substantial usage, it won't be too long before you receive a cease and desist.
Not at the minute. I might open source it in the future, especially if I get a cease and desist. Though hopefully even if it comes to that someone like the EFF will help me fight it.
Not a lawyer, but it's probably a bad idea to open-source something _after_ getting a C&D for it
Yeah, true. I'd definitely ask for legal advice before doing that.
So like libreddit (sp?) and teddit, another readonly scraper, the real API supports write access.
Yep, very similar. My guess is that ~80% of API usage is read-only, so covering this should reduce API costs significantly for developers.
For the GET /r/:subreddit/comments/:article endpoint, is there a limit to the amount of comments returned? If yes, how is it determined which get returned? Sorted by top? Best?
Yeah, currently the limit is 50 comments. I plan to implement the ability to choose a sort and limit, assuming the API actually gets some usage. Right now the sort is whatever the new.reddit.com default is.
When visiting the link, chrome just suggested I may mean to visit "reddit", never seen that before. I have safe browsing disabled, so I'm at a lost from where this comes from. https://i.imgur.com/l57osTi.png
clearly an anti phishing filter
This may be a very, very naive question but: is it possible to have a decentralized reddit that has centralized servers that cache the data?
Is this open source? I’d love to help out
github.com/plebbit

Lots of repos, everything is open-source

While impressive, I don't think IPFS can scale to any kind of real load that even a fifth of the users of reddit using this could handle. Its a super heavy daemon and if its just gateway users there is still a little bit of centralization going on. Like who runs "pubsubprovider.xyz" that most of the data is being relayed with? same with "plebpubsub.live"
you can see the list of providers in the settings page, and you can add your own providers to the list (for example your local IPFS node) https://plebbit-test.netlify.app/#/settings/plebbit-options

the idea is that if there's 100 providers eventually, and only 1 needs to not censor you to get your content, then it's unlikely you will be censored

we plan on adding IPFS webrtc and webtransport at some point, to reduce the need and load on the ipfs gateways, and whatever new that comes out that can help the browser/mobile clients. For example https://iroh.computer/ seems promising

the desktop client is fully P2P, it bundles an IPFS node, and the only requests it makes are through the IPFS node. (technically it makes one request to github for default communities, but we will remove that at some point). Also if your community or username uses a human readable name (optional), then you need to resolve that name somehow, we can technically support any name system anyone makes, and that might or might not be P2P.

Rdrama has already done it... did it better too
The site is definitely slow, but not so much that it is intolerable (at least in my experience).

It's a interesting idea but I think 4chan, as the internet watering hole, has the core audience captured already and has done so for the last 15ish years. I am curious as to what the marginal value is here.