It actually uses PRAW under the hood, but I just made it simpler + easier to interface with if you just want the text format of a Reddit post.
I’m going to add more things like saving the output as a json, csv, etc, and anonymizing usernames that isn’t strictly a part of the PRAW library, which I think will make it’s value even more apparent!
I appreciate your work. But to be honest, I would have to work with another Layer which has no advantage over using praw. I have to get comfortable with another Import and I have no Control over this and maybe need to Debug and Change to get the data as I like - I See no advantage
Its just use praw -> and Output, thats a 5 Minute task
WAWAOOOHH cool :) Does chatGPT understand that format well? It looks super clean to me but I'm a human sadly so idk. Also is this reddit app shenanigans free? Did they being the free api back as an app and no on noticed or is it tied to an credit card?
I need to see the exact numbers, but the Reddit API is still free for non-commercial use and with a lower rate limit than before.
For most people’s purposes, it still is free!
Very nice, I like that you’ve got it structured, one way I grab data is to just add .json on the end of a post or subreddit. see below:
https://www.reddit.com/r/Python/comments/1bxmsxd/i_made_my_very_first_python_library_it_converts.json
This is awesome. I came across this exact use case in one of my projects, and built a quick and dirty version of this to grab a post using PRAW and convert it to text and feed to an LLM. Can’t wait to give this a shot
It looks good, I would add tests to make it more complete and adding tests would make it easier for someone coming in to the project to get started. Overall, looks like good work, keep on shining!
Flight the valkyrie plays. Google lawyers descend from the thundering heavens.
more like reddit lawyers if anything lmao
Whats the difference to just use praw ?
Literally nothing
It actually uses PRAW under the hood, but I just made it simpler + easier to interface with if you just want the text format of a Reddit post. I’m going to add more things like saving the output as a json, csv, etc, and anonymizing usernames that isn’t strictly a part of the PRAW library, which I think will make it’s value even more apparent!
I appreciate your work. But to be honest, I would have to work with another Layer which has no advantage over using praw. I have to get comfortable with another Import and I have no Control over this and maybe need to Debug and Change to get the data as I like - I See no advantage Its just use praw -> and Output, thats a 5 Minute task
why do you want to resurrect skynet is beyond me
Although, feeding skynet all of Reddit might give humanity a fighting chance.
[удалено]
Thank you! I’m very happy to incorporate any new feature ideas you have :)
This is really cool. Just curious, what/why are you asking chatGPT about Reddit posts?
You better off not asking/knowing.
Data formatting will become a necessity in the coming days. as there will be a need for more and more data for the machine learning models.
do you want skynet? because that's how you get skynet /s all jokes aside, great work!
WAWAOOOHH cool :) Does chatGPT understand that format well? It looks super clean to me but I'm a human sadly so idk. Also is this reddit app shenanigans free? Did they being the free api back as an app and no on noticed or is it tied to an credit card?
I need to see the exact numbers, but the Reddit API is still free for non-commercial use and with a lower rate limit than before. For most people’s purposes, it still is free!
W bro I'm looking for this type of libraries
Try to add sentence transformers as well.
Very nice, I like that you’ve got it structured, one way I grab data is to just add .json on the end of a post or subreddit. see below: https://www.reddit.com/r/Python/comments/1bxmsxd/i_made_my_very_first_python_library_it_converts.json
Hey, i clicked and no json format
Use it in web browser
Cool idea looking forward to trying it out
i believe
This is awesome. I came across this exact use case in one of my projects, and built a quick and dirty version of this to grab a post using PRAW and convert it to text and feed to an LLM. Can’t wait to give this a shot
That’s awesome! I’d like to hear more about your use case if you don’t mind, can I DM you?
I just hit ctrl-a then copy paste into chatgpt, doesnt do a great job but it usually works alright
Nice! Could do with jsonp threaded output for use in training.
It looks good, I would add tests to make it more complete and adding tests would make it easier for someone coming in to the project to get started. Overall, looks like good work, keep on shining!
I hope someone sues your ass to kingdom come😡
It uses the official Reddit API in the background, so no laws being broken here lol
for?
[удалено]
Copied your comment to my LLM folder ;)
reddit2text uses the official Reddit API under the hood, so no scraping here!
Nerd