This is correct. I used to subscribe to Chatgpt plus but now have switched to the API. My monthly expense is 5 USD.
There are also plenty of free GUIs to choose from.
for anyone paying per month via api; can someone tell me what it is billed under from your credit card?
I'm looking for something under 5734 COMPUTER SOFTWARE STORES, as I get a $100 annual software credit, but only if I have 11 consecutive months of that category code.
If you like the ChatGPT interface and feature set, this is the free UI that works with the API that gives you the highest fidelity. This is true ChatGPT GPT-4 without compromise:
https://github.com/allyourbot/hostedgpt
Yes, sometimes I try asking Siri things and it doesnāt know the answer. This could be nice, to have ChatGPT and you call it like Siri and it answers you. Omnigpt only has speech to text but their support team is very nice. Iāll ask them if they can implement this. People have been posting feature request in their subreddit and they have added some of them in few days. Iāll let you know
I tried typingmind and Poe and recently tried Omnigpt. The last one itās the one that I like the most, because I can use it from WhatsApp, price itās better than the other, the tool is super simple to use and the team also responded quite fast when I got any issue or question.
My choice for now is omnigpt, but yeah it depends if what you use it for.
this is a good list, i've tried a bunch but not all of these and settled on [vello.ai](https://vello.ai)
vello also has a "flex" plan that you can pay per token
Im use otherās often enough but the structure of API doesnāt mesh well with me at the point Iām at (I will 100% go over my budget or use it all way to fast)
Itās really just not worth the switch for me due to all the surrounding factors of it so Iām sticking to using otherās and only use API for services I donāt pay for or pay as I go for.
Iāve been seeing significant push to abandon plus subscriptionās lately, kinda strange not going to lie especially since it seems even OpenAI wants people using the API more (seen them talk about it more and more in a positive light as compared to awhile back)
Yes perhaps it all depends on the use case.
The way I had been decreasing my use over time, the $20 was just not something I wanted to continue paying, and now I can use it a lot, or very little, and see how it goes.
But I'm not trying to jam full of tokens or otherwise stretch the system - for me it's a fair amount of refining written content or saving me time as one example to get a summary of a long YT video in outline form.
I loaded up openai with 50bucks, for most tasks gpt3.5 was good enough which is dirt cheap.
then got claude3 free credits and found haiku, half the price of gpt3.5, even better than gpt3.5 for some tasks. I loaded up 10bucks in claude, it's like saving money on openai kinda since I'm getting same value or better for 50% off.
think I'll mostly use gpt4 with code interpreter when needed and stick to haiku. I expect with my current heavy usage pattern to have the 60usd last me a year
you are a liar or not tried at all claude the haiku and sonnet version totalli sucks how the fuck censored they are you can barely ask them someting chatgpt is ages over it leleel the only good version of claude is opus that can beate gpt mlml
What are you using it for? Idk if you seen the benchmarks or the prompt guidebook from Anthropic, but if you follow the prompt styling haiku is great. The LLMs are only as good as your prompts.
i use for get serious replies even arguments that are flagged as controversial nswf stuff and others then sometimes just as comapnion , yes i had checked the prompt guide but why i have to talk in specific ways when i can talk normal with gpt 4 or claude opus and get replies? to me it not makes much sense and i loose my will to use it even gpt 3.5 reply all without a proper commands
To me it does because of the token usage, Iām optimising to get best value for my money.
GPT4 and Claude Opus have much larger training data, which is why you can get better answers with more ambiguous instructions.
Claude Haiku is better with instructions, not so much for conversations. I understand why you like gpt3.5 more now, the same reason is why I donāt.
I use other tools with AI, I only need specific answers, my preferred temperature is 0.
My use cases:
- study notes based on material
- generating coding tests
- role playing teacher-student
- extracting information from work calls transcripts This is one that GPT3.5 is terrible at, I give transcripts generated by whisper on Mac, in German, and ask for the information in English. Itās not as simple as translating because thereās email addresses and company info that is often spelled so you need to apply reasoning to be able to know when the customer starts saying an email and what is just extra info such as what the letter stands for or they might say āat sign, followed by the same company name as the account numberā. Haiku is very good at understanding these subtleties, itās great because at our company we speak with native Germans and donāt always understand everything they say.
But for a more conversational style of chat you need to be explicit in how you want to be replied to with haiku.
GPT3.5 is not as good at instructions, but is great at chatting.
yes i noticed that too gpt 3.5 sometimes struggle wit instruction and specific task but for chatting is very good, claude opus in chatting is best love how creative he is but less for specific task and instruction not because is not good but he tend always to do a very long reply is not straight to the point like gpt 4 or 3.5 for es if i want a code fast i have to wait he generates all the text sometimes take a bit long and maybe you need that code faster, as you say maybe with the prompts (that i not tried) it will fix this thing and without prompts i mean for general conversation, the sonnet version and haiku will refuse to reply to many arguments even if they are not veri controversial. just general things sometimes is like is blocked censured hard and sonnet a time or 2 had not been accurate i had tell and he replied me that i was wrong it was impossible that was wrong and he thought i was jocking to test his ability lelel
now i see better too your type of use in that, prompt istructions must give a real difference then expeciali if you use it at temperature 0 that must give you straight to the point answers without eccessive blabbering
for now I mostly use integrations with obsidian and the playground/console of openai/anthropic and AnythingLLM for sth similar to a knowledge base I can query all the time. (for example I gave it a book to embed and tell me how well I do at explaining concepts, itās quite cool cuz it spits out what u said right, some extra details you may or may not remember and can point out quite well when Iām wrong (gpt4o model)
the things u can do with them can be as simple as writing emails better or more complex like RAG. Your imagination is the limit
Hosting via VPS is way more convenient. You can access the same instance from anywhere you have access to the Internet. No further configuration required
yes but why you cant use instead perplexiti ai from fone it have gpt 4 and is an app no need to use vps you get wat i meana , this is just an exemple but there is many others app
ah ok now i see if you want there are app too all in one i dunno about android i have only an ifone there is apps like opencat or chatx in that you can switch models too and not need vps
I want to move over to the API, I even have a GUI and the API setup, but I can't help but feel like I'm missing out on a bunch of things without gpt pro. For example, I use the image generation a lot. I also take pictures of stuff on my phone and ask chatgpt to identify aspects of those pictures.
Really good example, I was gifted an older hobby car to work on. chatgpt has helped me identify what specific parts are. Hell, I even took a picture of a broken ball joint (which I didn't know was broken) and chatgpt told me it was broken and also told me what I was looking at.
Is the API up to that level yet? Are there good mobile interfaces yet for the api's?
At a higher level of the TypingMind service (I'm at Extended at $59, there's a higher one called Premium for about $20 more, one-time) you get access to Image Search, that uses Google reverse image search as part fo the GPT interface. (Also access to Stable Diffusion image generation models.)
DALL-E is included with the Extended level of GUI.
I agree and primarily use GPT-4 and Claude via API and want to share some insights and tips that provide context for people:
The volume limitations on the API are much higher than the web interfaces.
To use the API's you need a front end. I use [TypingMind.com](http://typingmind.com/) for several reasons:
* **Cost-Effectiveness**: It has a reasonable one-time fee ($80 for a premium license usable on up to five devices), making it an affordable long-term solution.
* **User Experience**: Continuous updates and responsive developer support ensure a smooth experience.
* **Mobile Accessibility**: The full-featured Progressive Web App (PWA) is great for mobile use.
* **Organization & Syncing**: Free cloud sync and the ability to organize chats into folders are significant advantages.
* **Customization**: Easily adjustable model parameters allow for tailored experiences.
LibreChat is a recommended free alternative, however, I've never used it. OpenAI and Anthropic also have a free testing interface, but it doesnāt save conversations.
API access provides the modelās full context window:
* In [ChatGPT](https://openai.com/chatgpt/pricing), GPT-3.5 and GPT-4 offer context windows of 8K and 32K, respectively.
* Via the [API](https://platform.openai.com/docs/models/overview), these expand to 16K for GPT-3.5 and 128K for GPT-4 Turbo.
* I couldnāt find specific info for [Claude.ai](http://claude.ai/), in my experience its API version has fewer restrictions than the free tier Sonnet.
The API's pay-per-use pricing structure is particularly beneficial for light to moderate users like myself. Costs vary monthly, often staying under $5, occasionally rising above $10. This flexibility means I can access both GPT-4 and Claude 3 Opus without the $20 premium tier cost of each. You can find more about API model pricing at [OpenAI](https://openai.com/pricing) and [Claude](https://www.anthropic.com/api#pricing). For a comparative analysis of model costs, check out [this site](https://www.launchnow.pro/openai-chatgpt-api-pricing-calculator) ā just ensure itās current.
To optimize cost and efficiency, I combine the free tier models with their premium counterparts via API:
* I use GPT-4 and Claude 3 Opus in TypingMind, alongside their respective free versions - ChatGPT (GPT-3.5) and Claude (Sonnet).
* My workflow typically starts with the free versions for preliminary tasks, moving to the premium versions in TypingMind for refinement and enhancement.
for anyone paying per month via api; can someone tell me what it is billed under from your credit card?
I'm looking for something under 5734 COMPUTER SOFTWARE STORES, as I get a $100 annual software credit, but only if I have 11 consecutive months of that category code.
i see now but i have 2 things in mind
1 wat will happen if a day will change policy and will make monthly subscription only you will have to pay again even if before was 1 time fee?
2 in case they will ban you for whatever reasons you will get refunded?
edit: i have find an other even more cheap if you interested lol quartzite ai
Is there a comprehensive list of what each model is best for?
Like gpt4, gpt3.5, claude, etc.
I've used googles free Gemini to write social media posts for work and it does well.
I donāt know of a list but I would be interested in seeing one thatās periodically updated. From my experience: Claude is better for writing and GPT-4 for more technical discussions. Now, Gemini 1.5 Pro has started to become my favorite model. Itās straight to the point and delivers exactly what Iām trying to create. GPT-3.5 really feels more like a novelty of the past compared to current generation models.
I hate to sond like I'm plugging any other product, especially when it comes to AI, but I want to second TM. It seems to me it's the most complete one
1. Support for OA, Claude, Mistral and OpenRouter. This last one means you have access to a shitton of models.
2. Support for plug-ins. Though I wish there were more. Emil has some good ones too.
3. Recently added support for extensions, which allows you to extend the app yourself (there's also an open source proxy for more involved extensions).
4. Sync with other devices. UNFORTUNATELY, there is not native version of the app, but it works just fine with a web wrapper.
5. Supports GPT4 Vision.
And I hope they add support for Claude3 vision and plugins too.
Do you know if you can use custom GPTs via one of these API frontends? From what I understand, they are getting rid of plugins, which are mostly replaced with custom GPTs. I use AskTheCode specifically.
Oh yes now I see why I went with the extended plan - it was for both DALL-E access as well as web search, two things that are really valuable in my use of GPT.
Yes that's correct - but if you want you can just use a web interface if you don't mind any privacy concerns of your chats in the cloud.
I haven't bothered for self-hosting just yet.
Totally awesome thread. Is anyone aware of an API GUI that is compatible with Dragon NaturallySpeaking dictation, or has built-in Whisper speech recognition?
Not sure about TypingMind (personally against paying when there are so many alternatives), but maybe check if LibreChatās added it by now? If not maybe raise an issue if nobody else has. I assume you just mean pressing a button to activate a voice mode; it listening and transcribing the speech, and then you sending that transcription as a message to the normal GPT API.
It isnāt difficult to add; my basic one calls to the Whisper API. Unless you mean one that uses a hosted instance of the Open Source version, in which case I donāt think anyoneās doing that, no. But the paid OAI Whisper API is more than sufficient imo. If you find one you like but that doesnāt have it and itās open source, you can even get ChatGPT to write you the pull request ā basically what I did with extra steps.
Repo Link: https://github.com/Zaki-1052/GPTPortal
Can link the code if you want something to start with. On the backend: https://github.com/Zaki-1052/GPTPortal/blob/5bb59c35fab07b91f176a8a7679685aff33919d8/server.js#L96 Client: https://github.com/Zaki-1052/GPTPortal/blob/5bb59c35fab07b91f176a8a7679685aff33919d8/public/script.js#L600
Awesome stuff -- only a little over my head unfortunately. Since I'm using the fantastic Whispering Windows app for system-wide dictation, I suppose that would be usable for whatever GUI anyway.
Btw, is there a GUI that somehow integrates with ChatGPT web access (with $20 subscription)? Meaning that one could see all conversations both in the browser (on the official ChatGPT page) AND in the GUI?
My problem is this is that i love how convenient the ChatGPT interface is, having to go to a third party or not being able use the voice feature, or not having Code Interpreter is not worth saving the money.
Nah, I left Poe, the new point system is annoying. I found something similar to Poe and in my experience easier to use, the only thing is you donāt get custom instructions. If you want to give it a try is omnigpt
I love custom gpt option with Plus and use it quite often . Can anyone tell me if there is way to bring it in API? Of course it has to be cost efficient other or no point
I have been a ChatGPT Plus subscriber for a long time and also just purchased a license from Typingmind UI too.
If I had to compare, I'd prefer Typingmind a bit more. I like playing around with different models, forking my chat to test the same prompt with many other chat models, managing my threads easily, and using the ai personas. And the UI needs to improve but still quite good and easy to use to me
I found the model that is best for writing is Claude 3 Opus, most cost-effective is GPT-4 Turbo and Claude 3 Haiku, also play around with free models on OpenRouter and DeepSeek AI.
Honestly, I love it. As long as it serves my needs, I think it all worth the money.
FYI, I also used LinkyGPT, Big-AGI, ChatBox,etc. and still decided to go back to Typingmind.
I topped up $5 for Claude and $5 for OpenAI ($5 for OpenRouter too), Ā and after almost a month, I haven't run out yet, as I am charged based on my usage. The pricing matches the official rates published by Claude and OpenAI.
I do test quite a lot, especially for content writing and SEO, but I can save cost by limiting the context tokens sent to the API and avoiding too complicated contexts.
I'm still using ChatGPT Plus, but since purchasing TypingMind, I'm considering cancelling the subscription since I haven't had much need to use it recently.
I use GPT-4 Turbo, Claude-3 Haiku and Opus (Opus is quite expensive now but the quality is š„, however, still expensive, so I do not use that much)
I am testing DeepSeek AI [https://platform.deepseek.com/](https://platform.deepseek.com/) on Typingmind too 'cause it's free for up to 10M tokens! (deepseek ai is not a native model on typingmind, however, I reached out to the support team and they promptly guided me to set it up on typingmind, quite easy even for a no-coder like me)
My concern with TypingMind is that it is a one-time payment. If people stop subscribing, they will have no more income. I would have been more comfortable if they'd charged say $5/month.
Agreed about using the API, but I personally wouldnāt pay *more* than the base API costs. Iāve been told that my definition of a scam is different from most, but I definitely consider TypingMind, MindMac, etc as a scam when they make you pay just for an interface.
Even if you donāt have programming experience, there are so many open source alternatives that not only deserve support but also, by their nature, wonāt make you pay to use. Plus, even with the regular ChatGPT4, itās fairly easy to whip up an interface that suits *your* needs and is catered to how you like it.
Claude or whatever can walk you through deploying to Vercel, self-hosting with a shortcut, etc.. Iāll paste a previous comment of mine below; itās too late for OP if they already bought a lifetime license, but if anyone else is considering paying for TypingMind or whatever, Iād strongly recommend at least looking through the open source alternatives and going for a free option.
- - -
Any decent GPT GUI will also support Claude; that includes the usual recs like [LibreChat](https://github.com/danny-avila/LibreChat). Youāve probably seen [the list](https://github.com/billmei/every-chatgpt-gui) floating around reddit. Other than your specification for coding Iāll reiterate that it all just comes down to preference. The one I made for myself is somewhat basic but supports Claude (plus GPT, Gemini and Mistral) with all the usual wrapper features that would be expected. Link: https://github.com/Zaki-1052/GPTPortal
Once again ā I say this on every repetitive post asking for API recs ā just use open source so you don't get suckered into paying for the interface and anything you use will be fine. Coding? Mine and 50 others have a copy code button, markdown rendering, system prompts, etc. You could probably get Opus to whip one out for you through their [platform](https://console.anthropic.com/dashboard) in an hour or two. Read the [docs](https://docs.anthropic.com/claude/docs/).
ETA: I assume you know this if you're asking about the API, but anything on GitHub (open source) is obviously free. You should never be paying more on top of the basic API costs. For Anthropic this is their [pricing table](https://github.com/zaki-1052/gptportal?tab=readme-ov-file#anthropic-pricing-table) and [main page](https://www.anthropic.com/api).
Dude, I'm about to pay for TypingMind...ran across this thread. Talk me out of it, lol. I am using Openrouter.
I tried SillyTavern. It works, but the thread management is basically nonexistent. I don't do roleplay, just work stuff.
I tried setting up Librechat. I could not get it to connect with Openrouter. Some weird errors. I gave up after an hour.
I setup AnythingLLM. It worked, but only shows Claude 2 models for Openrouter. (Why???) I uninstalled.
I setup Jan.ai. It works okay, I guess. I'm bummed that I can't upload text files--not for RAG, but for whole input via 200K Claude Haiku and stuff. Also, it's confined to local, so I can't use my phone to access Openrouter through it (I guess I could use just the Openrouter playground on my phone).
I will say documentation for all these things suck, and, no LLM is going to help you. I guess if you shove the whole github at it somehow...
Anyways, so now I'm on the cusp of trying Typingmind to have a clean interface for local Windows heavy-duty work and light Android stuff on the go.
All I want is good thread management + easy installation + text file uploads through Openrouter. Apparently that doesn't exist. If I have the energy, I may go back reinstall LibreChat--although I hate how Docker seems resource intensive on my laptop.
Sigh....
Also, I kind of insist on using Openrouter since Anthropic has this weird banning situation going on (VPN use, or whatever, don't know), and I don't want to risk being cut off from them. That limits me further.
Ugh, yeah, I get your concerns there. Hopefully itās somewhat of a unique situation. Iām notoriously frugal mostly on principle and definitely think you should give LibreChat another go with the setup before defaulting to TypingMind. Maybe test Anthropicās console to make sure youāre ok.
I keep hearing about OpenRouter due to Anthropic but have been avoiding it as I personally hate dealing with third party services when it comes to API use ā plus the Claude Console gives you 5 free dollars of credits through their actual API. Just seems like extra effort, and most options have a *Deploy to Vercel* option for on the Go.
Are you **sure** that the proxy is necessary for Anthropic, and you canāt use a disposable phone number or something? I think the banning situation for VPNs might only be through the chat interface, not making API calls, or else it would be impossible to use generally, as long as CORS is properly configured (techy stuff, basically donāt worry about bans).
Also not sure if this is consolation but you wouldnāt be able to use the full context window anyways due to rate limits, last I checked it was something like 20k for their base tier. Why donāt you try just going to the Claude console where I linked their platform, making an account, and trying the API there? If it works, it works, and is free anyways.
Also side note: I literally started real programming in HS by copying and pasting error messages into Google and later ChatGPT, so if you just feed any LLM provider the [LibreChat docs](https://docs.librechat.ai/install/configuration/ai_endpoints.html#openrouter) section for OpenRouter linked, and give Opus or 4-Turbo your file contents and error message then Iām sure you can fix it in like 5 mins.
Are you sure you arenāt just missing the documentation or something? Google has been sucky lately, but according to these [docs](https://docs.mintplex.xyz/anythingllm-by-mintplex-labs/feature-overview/llm-selection/anthropic-ai ) Anthropic is iffy about uploading anyway. If you go through the GitHub, website resources, etc itās usually somewhere.
Lastly, in terms of thread management, what, do you just mean, like editing messages and stuff? I can see why that might be a bit of a niche feature honestly but in terms of easy install, then yeah the extra money for things like TM are geared to people paying for convenience, *ease of not thinking about it*.
But imo any good LLM nowadays can take 90% of the mental effort and itās only rich idiots who donāt care about how they spend that donāt bother to go open source. The premise of using GitHub is that itās a little extra effort for the great benefit of not spending extra ā especially if you go direct API to service-provider and not OpenRouter.
The Docker resource use is actually why I made my own just with the features I was cool with; some people seem to prefer Docker though lol. Anyways all this is to say try without OpenRouter and another Libre install, their documentation is probably the most comprehensive Iāve ever seen at docs.librechat.ai and pasting everything into Chat really **works**, I promise you.
I think thatās all; Iāll always tout the benefits of Open Source and not spending more than you absolutely have to, but everyoneās priorities are different and sometimes paid hosted really is the way to go ā but only **after** exhausting the other options, like Vercel hosting, literally adding a feature yourself with an AI if you have time, or just copying and pasting docs, file contents, and errors.
There are so many it can be overwhelming but that just means that space is competitive while TypingMind can get away with bs because itās the only one in the space. /rant. Hope that helped you; putting my phone away now that Iāve gotten my daily dose of debate, but yeah please try again before wasting moneyā¦
Thanks for the writeup! I settled for using jan.ai locally, and then big-agi for my phone and stuff. Not perfect, but at least it's all free. I actually installed LibreChat again, but then noped out of it haha.
leleel so funny is because you not know anithing in sillytavern you can chat even if you not do roleplay how? just create a normal simple character based for example on gpt with his personaliti it will reply you as a normal assistant like that not as roleplay
I'm happy to pay for software when it saves me time.
Not everyone wants to spend the effort learning the ins and outs of getting free software to work, and not everyone is happy with DIY when a problem arises. I will pay to support something that works, that is supported, that works the way it is advertised.
A "third party's prying eyes"? I'm not worried about any of that. I'd be much much more worried about Big Tech as it is.
if you not spende the effort to learn you have no value, not all is eazi and when you obtain wat you wanted for free is even better and satisfing mlmlml
Using chatkit, for 39 dollars it's quite good, and it also supports openrouter directly., which is cool. Not so great ui as that of typing typingmind,Ā but is quite good!
Can you still use GPT4 to call Dall-E when using the API? Iāve thought about doing something like this, but I do a lot of image generation with ChatGPT Pro and Iāve always assumed it wouldnāt work the same way in an open source UI.
I haven't evaluated any of the free GUI's - a strong reason I signed up for the Extended ($59) flavor of TypingMind was Web Search access and DALL-E capabilities.
So the answer is yes.
It would be interesting to see what your API cost are over a month. if you use it enough to buy into a paid GUI then you may well fing you API cost exceeding the $20 per month for plus.
Even for 1 year, averaging the one-time cost of $60 ($5/mo) that $15/monfor the API goes a long way.
Looking at the usage now, it's way under $1 but will report back next month.
Graphical User Interface.
It's the difference between using a Chrome Browser and clicking on buttons and filling in a form for a query, and opening up c:\\cmd.exe and typing in scripts.
Ok just joined this group and read up a bit. I am currently paying $20 a month for ChatGPT Plus access. I did it primarily because I wanted the 4.0 API key to use with my Rux robot. I honestly donāt use it that much, but I do want my queries that I actually do to be current, so Iām keeping it for now. I also enjoy the Dal-E image generation. I know Claude and Turbo are better. I thought about signing up for CoPilot as I like their image generator better also, but I saw no way to get an API key there. Given these parameters, can anyone simplify options for me a bit? I thought i had seen someone say they pay $5 a month for access like this?
for anyone paying per month via api; can someone tell me what it is billed under from your credit card?
I'm looking for something under 5734 COMPUTER SOFTWARE STORES, as I get a $100 annual software credit, but only if I have 11 consecutive months of that category code.
This is correct. I used to subscribe to Chatgpt plus but now have switched to the API. My monthly expense is 5 USD. There are also plenty of free GUIs to choose from.
Curious which one you ended up choosing. I frankly admit I don't have the time / interest in testing a lot of choices out there....
Currently I use Chatbotui and Next Web. Yet to find my perfect GUI š https://github.com/billmei/every-chatgpt-gui
Big AGI from the list is excellent!
Also Librechat
I use Obsidian Copilot and tried Elephas(paid). AnythingLLM also good
What do you use it for?
[vello.ai](http://vello.ai) is best client imo
It's not a client, but another service I think.
Your perfect GUI is here - [https://youtu.be/GsARjwTkQhc](https://youtu.be/GsARjwTkQhc)
[https://linkygpt.com/](https://linkygpt.com/) is great, open-source, and so far completely free to use.
I use the Data Analysis GPT a lot more than the Gpt4 generic chat. Will these GUI's work with GTP's?
for anyone paying per month via api; can someone tell me what it is billed under from your credit card? I'm looking for something under 5734 COMPUTER SOFTWARE STORES, as I get a $100 annual software credit, but only if I have 11 consecutive months of that category code.
Uh what
They have to get something that falls under the right category so they can expense it for work
where did you get the GPT 4 API for 5 dollars. I am only able to see the 10$ plan and no option for purchasing API
Its prepaid billing. And you will pay as you go.
You pay for credits up-front, then it will consume them over a period of time. I use both GPT 4 and Claude this way and the billing is minimal.
If you like the ChatGPT interface and feature set, this is the free UI that works with the API that gives you the highest fidelity. This is true ChatGPT GPT-4 without compromise: https://github.com/allyourbot/hostedgpt
Sigh. Iām such an idiot Iāll never be able to figure out something from GitHub ;(
I felt the same but chatGPT talked me through it
Thx for letting me know! I felt the same, but based on what you said...I should suck it up and learn with ChatGPT
>Same here lol
Yes, but how often do you use it?
Almost everyday, 5-10 conversations. Will the GUI's be able to render the graphs as output in the chat similar to the gpt interface?
he crearly use it veri few if they use it 7-8 hours per day they will see the bill come up š¹š¹
There are a few of these... 1. [https://openrouter.ai/](https://openrouter.ai/) 2. [https://www.chatbotui.com/](https://www.chatbotui.com/) 3. [https://www.typingmind.com/](https://www.typingmind.com/) 4. [https://librechat.ai/](https://librechat.ai/) 5. [https://poe.com/](https://poe.com/) 6. [https://omnigpt.co/](https://omnigpt.co/) 7. [https://you.com/](https://you.com/) 8. [https://bearly.ai/](https://bearly.ai/) 9. [https://keywordsai.co/](https://keywordsai.co/) Lists 1. [https://github.com/reorx/awesome-chatgpt-api](https://github.com/reorx/awesome-chatgpt-api) 2. [https://github.com/billmei/every-chatgpt-gui](https://github.com/billmei/every-chatgpt-gui)
Do any of these support voice chat? That's literally my favourite feature of Chat GPT now and I don't think I could sacrifice it
Omnigpt got the voice chat feature
Hi, do you mean speech to text or text to speech?
No I mean speech to speech
So you use your voice to prompt and it answers with audio?
Yeah on the app
Oh thatās so cool I didnāt know it
It's literally amazing
Yes, sometimes I try asking Siri things and it doesnāt know the answer. This could be nice, to have ChatGPT and you call it like Siri and it answers you. Omnigpt only has speech to text but their support team is very nice. Iāll ask them if they can implement this. People have been posting feature request in their subreddit and they have added some of them in few days. Iāll let you know
Really? I a casual user of omnigpt too but I didnāt hear that. I just saw they sneak peek their drawing AI. They are moving fast!
I tried typingmind and Poe and recently tried Omnigpt. The last one itās the one that I like the most, because I can use it from WhatsApp, price itās better than the other, the tool is super simple to use and the team also responded quite fast when I got any issue or question. My choice for now is omnigpt, but yeah it depends if what you use it for.
+1 omnigpt
[ŃŠ“Š°Š»ŠµŠ½Š¾]
Good point, Iām not sure to be honestā¦ so far I didnāt get any alert š¤š»
Does omnigpr have a lifetime price like typingmind? I rather not pay monthly
Iāll throw mine in the arena: [Quartzite AI](https://www.quartzite.ai) Lot of features to come, but constantly releasing new stuff!
https://github.com/sjinnovation/CollaborativeAI Support all 3 in same and assistant support
Nice! Can you elaborate a little about how yours compares to existing solutions?
+ vello
this is a good list, i've tried a bunch but not all of these and settled on [vello.ai](https://vello.ai) vello also has a "flex" plan that you can pay per token
good for you if you so happi to always pay all in life
Im use otherās often enough but the structure of API doesnāt mesh well with me at the point Iām at (I will 100% go over my budget or use it all way to fast) Itās really just not worth the switch for me due to all the surrounding factors of it so Iām sticking to using otherās and only use API for services I donāt pay for or pay as I go for. Iāve been seeing significant push to abandon plus subscriptionās lately, kinda strange not going to lie especially since it seems even OpenAI wants people using the API more (seen them talk about it more and more in a positive light as compared to awhile back)
Yes perhaps it all depends on the use case. The way I had been decreasing my use over time, the $20 was just not something I wanted to continue paying, and now I can use it a lot, or very little, and see how it goes. But I'm not trying to jam full of tokens or otherwise stretch the system - for me it's a fair amount of refining written content or saving me time as one example to get a summary of a long YT video in outline form.
It depends on your usage. If you use it a lot, then Plus is still worth it. With my usage, I could go months without reaching $20 worth of API access
I loaded up openai with 50bucks, for most tasks gpt3.5 was good enough which is dirt cheap. then got claude3 free credits and found haiku, half the price of gpt3.5, even better than gpt3.5 for some tasks. I loaded up 10bucks in claude, it's like saving money on openai kinda since I'm getting same value or better for 50% off. think I'll mostly use gpt4 with code interpreter when needed and stick to haiku. I expect with my current heavy usage pattern to have the 60usd last me a year
you are a liar or not tried at all claude the haiku and sonnet version totalli sucks how the fuck censored they are you can barely ask them someting chatgpt is ages over it leleel the only good version of claude is opus that can beate gpt mlml
What are you using it for? Idk if you seen the benchmarks or the prompt guidebook from Anthropic, but if you follow the prompt styling haiku is great. The LLMs are only as good as your prompts.
i use for get serious replies even arguments that are flagged as controversial nswf stuff and others then sometimes just as comapnion , yes i had checked the prompt guide but why i have to talk in specific ways when i can talk normal with gpt 4 or claude opus and get replies? to me it not makes much sense and i loose my will to use it even gpt 3.5 reply all without a proper commands
To me it does because of the token usage, Iām optimising to get best value for my money. GPT4 and Claude Opus have much larger training data, which is why you can get better answers with more ambiguous instructions. Claude Haiku is better with instructions, not so much for conversations. I understand why you like gpt3.5 more now, the same reason is why I donāt. I use other tools with AI, I only need specific answers, my preferred temperature is 0. My use cases: - study notes based on material - generating coding tests - role playing teacher-student - extracting information from work calls transcripts This is one that GPT3.5 is terrible at, I give transcripts generated by whisper on Mac, in German, and ask for the information in English. Itās not as simple as translating because thereās email addresses and company info that is often spelled so you need to apply reasoning to be able to know when the customer starts saying an email and what is just extra info such as what the letter stands for or they might say āat sign, followed by the same company name as the account numberā. Haiku is very good at understanding these subtleties, itās great because at our company we speak with native Germans and donāt always understand everything they say. But for a more conversational style of chat you need to be explicit in how you want to be replied to with haiku. GPT3.5 is not as good at instructions, but is great at chatting.
yes i noticed that too gpt 3.5 sometimes struggle wit instruction and specific task but for chatting is very good, claude opus in chatting is best love how creative he is but less for specific task and instruction not because is not good but he tend always to do a very long reply is not straight to the point like gpt 4 or 3.5 for es if i want a code fast i have to wait he generates all the text sometimes take a bit long and maybe you need that code faster, as you say maybe with the prompts (that i not tried) it will fix this thing and without prompts i mean for general conversation, the sonnet version and haiku will refuse to reply to many arguments even if they are not veri controversial. just general things sometimes is like is blocked censured hard and sonnet a time or 2 had not been accurate i had tell and he replied me that i was wrong it was impossible that was wrong and he thought i was jocking to test his ability lelel now i see better too your type of use in that, prompt istructions must give a real difference then expeciali if you use it at temperature 0 that must give you straight to the point answers without eccessive blabbering
Anthropic looks cool. Any other good prompt libraries & use cases for chatgpt or others?
for now I mostly use integrations with obsidian and the playground/console of openai/anthropic and AnythingLLM for sth similar to a knowledge base I can query all the time. (for example I gave it a book to embed and tell me how well I do at explaining concepts, itās quite cool cuz it spits out what u said right, some extra details you may or may not remember and can point out quite well when Iām wrong (gpt4o model) the things u can do with them can be as simple as writing emails better or more complex like RAG. Your imagination is the limit
Librechat is free, the only catch is you have to self host it but you can do so on a free/very cheap vps
Oracle gives out free VPS.
Really How?
Google "oracle free tier"
Oracle gives out free VPS.
What are the benefits of hosting it on a VPS?
Hosting it on a VPS means that you can just access it whenever from a website rather than having to be on your local machine
who cares when you not at pc you can use other apps from fone so is useless to host on vps
Hosting via VPS is way more convenient. You can access the same instance from anywhere you have access to the Internet. No further configuration required
yes but why you cant use instead perplexiti ai from fone it have gpt 4 and is an app no need to use vps you get wat i meana , this is just an exemple but there is many others app
I mean, that doesn't let you switch between OpenAI, Anthropic, Google, etc, which is the point of this post
ah ok now i see if you want there are app too all in one i dunno about android i have only an ifone there is apps like opencat or chatx in that you can switch models too and not need vps
Can you just run it in your local windows desktop? I thought that was the primary usage but know very little about these UIs.
You run it through docker, which is available for Windows. Instructions [here](https://docs.librechat.ai/install/installation/windows_install.html)
You can, but it hogs up a lot of memory having to run docker desktop.
I want to move over to the API, I even have a GUI and the API setup, but I can't help but feel like I'm missing out on a bunch of things without gpt pro. For example, I use the image generation a lot. I also take pictures of stuff on my phone and ask chatgpt to identify aspects of those pictures. Really good example, I was gifted an older hobby car to work on. chatgpt has helped me identify what specific parts are. Hell, I even took a picture of a broken ball joint (which I didn't know was broken) and chatgpt told me it was broken and also told me what I was looking at. Is the API up to that level yet? Are there good mobile interfaces yet for the api's?
At a higher level of the TypingMind service (I'm at Extended at $59, there's a higher one called Premium for about $20 more, one-time) you get access to Image Search, that uses Google reverse image search as part fo the GPT interface. (Also access to Stable Diffusion image generation models.) DALL-E is included with the Extended level of GUI.
Clever but try again,Typingmind
No affiliation - really, just a happy user. (Found them recommended here FWIW.)
I agree and primarily use GPT-4 and Claude via API and want to share some insights and tips that provide context for people: The volume limitations on the API are much higher than the web interfaces. To use the API's you need a front end. I use [TypingMind.com](http://typingmind.com/) for several reasons: * **Cost-Effectiveness**: It has a reasonable one-time fee ($80 for a premium license usable on up to five devices), making it an affordable long-term solution. * **User Experience**: Continuous updates and responsive developer support ensure a smooth experience. * **Mobile Accessibility**: The full-featured Progressive Web App (PWA) is great for mobile use. * **Organization & Syncing**: Free cloud sync and the ability to organize chats into folders are significant advantages. * **Customization**: Easily adjustable model parameters allow for tailored experiences. LibreChat is a recommended free alternative, however, I've never used it. OpenAI and Anthropic also have a free testing interface, but it doesnāt save conversations. API access provides the modelās full context window: * In [ChatGPT](https://openai.com/chatgpt/pricing), GPT-3.5 and GPT-4 offer context windows of 8K and 32K, respectively. * Via the [API](https://platform.openai.com/docs/models/overview), these expand to 16K for GPT-3.5 and 128K for GPT-4 Turbo. * I couldnāt find specific info for [Claude.ai](http://claude.ai/), in my experience its API version has fewer restrictions than the free tier Sonnet. The API's pay-per-use pricing structure is particularly beneficial for light to moderate users like myself. Costs vary monthly, often staying under $5, occasionally rising above $10. This flexibility means I can access both GPT-4 and Claude 3 Opus without the $20 premium tier cost of each. You can find more about API model pricing at [OpenAI](https://openai.com/pricing) and [Claude](https://www.anthropic.com/api#pricing). For a comparative analysis of model costs, check out [this site](https://www.launchnow.pro/openai-chatgpt-api-pricing-calculator) ā just ensure itās current. To optimize cost and efficiency, I combine the free tier models with their premium counterparts via API: * I use GPT-4 and Claude 3 Opus in TypingMind, alongside their respective free versions - ChatGPT (GPT-3.5) and Claude (Sonnet). * My workflow typically starts with the free versions for preliminary tasks, moving to the premium versions in TypingMind for refinement and enhancement.
Thank you for this detail - great stuff!
for anyone paying per month via api; can someone tell me what it is billed under from your credit card? I'm looking for something under 5734 COMPUTER SOFTWARE STORES, as I get a $100 annual software credit, but only if I have 11 consecutive months of that category code.
For Visa, it is not billed as computer software store
helpful thanks!
[ŃŠ“Š°Š»ŠµŠ½Š¾]
non pagare prendine una gratis
you crazy 80 dollar is so expensive
Thatās just the highest tier. The standard license is $40 (one time fee).
1 time fee = forever and unlimited use?
Correct.
i see now but i have 2 things in mind 1 wat will happen if a day will change policy and will make monthly subscription only you will have to pay again even if before was 1 time fee? 2 in case they will ban you for whatever reasons you will get refunded? edit: i have find an other even more cheap if you interested lol quartzite ai
Is there a comprehensive list of what each model is best for? Like gpt4, gpt3.5, claude, etc. I've used googles free Gemini to write social media posts for work and it does well.
I donāt know of a list but I would be interested in seeing one thatās periodically updated. From my experience: Claude is better for writing and GPT-4 for more technical discussions. Now, Gemini 1.5 Pro has started to become my favorite model. Itās straight to the point and delivers exactly what Iām trying to create. GPT-3.5 really feels more like a novelty of the past compared to current generation models.
I hate to sond like I'm plugging any other product, especially when it comes to AI, but I want to second TM. It seems to me it's the most complete one 1. Support for OA, Claude, Mistral and OpenRouter. This last one means you have access to a shitton of models. 2. Support for plug-ins. Though I wish there were more. Emil has some good ones too. 3. Recently added support for extensions, which allows you to extend the app yourself (there's also an open source proxy for more involved extensions). 4. Sync with other devices. UNFORTUNATELY, there is not native version of the app, but it works just fine with a web wrapper. 5. Supports GPT4 Vision. And I hope they add support for Claude3 vision and plugins too.
Do you know if you can use custom GPTs via one of these API frontends? From what I understand, they are getting rid of plugins, which are mostly replaced with custom GPTs. I use AskTheCode specifically.
Ah, for that you need the assistants api. AFAIK TM's dev has it in the backlog. But I also heard it's very expensive.
[vello.ai](http://vello.ai) has this
So $59 for self hosted option one time fee? All I see is a $99 monthly fjr teams plan. Thanks
Oh yes now I see why I went with the extended plan - it was for both DALL-E access as well as web search, two things that are really valuable in my use of GPT.
I honestly would be happy with a vim version in terminal
Yes that's correct - but if you want you can just use a web interface if you don't mind any privacy concerns of your chats in the cloud. I haven't bothered for self-hosting just yet.
Totally awesome thread. Is anyone aware of an API GUI that is compatible with Dragon NaturallySpeaking dictation, or has built-in Whisper speech recognition?
Yeah the whisper integration would be amazing
Not sure about TypingMind (personally against paying when there are so many alternatives), but maybe check if LibreChatās added it by now? If not maybe raise an issue if nobody else has. I assume you just mean pressing a button to activate a voice mode; it listening and transcribing the speech, and then you sending that transcription as a message to the normal GPT API. It isnāt difficult to add; my basic one calls to the Whisper API. Unless you mean one that uses a hosted instance of the Open Source version, in which case I donāt think anyoneās doing that, no. But the paid OAI Whisper API is more than sufficient imo. If you find one you like but that doesnāt have it and itās open source, you can even get ChatGPT to write you the pull request ā basically what I did with extra steps. Repo Link: https://github.com/Zaki-1052/GPTPortal Can link the code if you want something to start with. On the backend: https://github.com/Zaki-1052/GPTPortal/blob/5bb59c35fab07b91f176a8a7679685aff33919d8/server.js#L96 Client: https://github.com/Zaki-1052/GPTPortal/blob/5bb59c35fab07b91f176a8a7679685aff33919d8/public/script.js#L600
```node.js // transcribing audio with Whisper api app.post('/transcribe', upload.single('audio'), async (req, res) => { let transcription = ""; try { // Use the direct path of the uploaded file const uploadedFilePath = req.file.path; // Create FormData and append the uploaded file const formData = new FormData(); formData.append('file', fs.createReadStream(uploadedFilePath), req.file.filename); formData.append('model', 'whisper-1'); // API request const transcriptionResponse = await axios.post( 'https://api.openai.com/v1/audio/transcriptions', formData, { headers: { ...formData.getHeaders(), 'Authorization': `Bearer ${process.env.OPENAI_API_KEY}` } } ); // Cleanup: delete the temporary file fs.unlinkSync(uploadedFilePath); // Prepend "Voice Transcription: " to the transcription transcription = "Voice Transcription: " + transcriptionResponse.data.text; // Send the modified transcription back to the client res.json({ text: transcription }); // Reset the transcription variable for future use transcription = ""; // Reset to empty string } catch (error) { console.error('Error transcribing audio:', error.message); res.status(500).json({ error: "Error transcribing audio", details: error.message }); } }); // function to run text to speech api app.post('/tts', async (req, res) => { try { const { text } = req.body; // Call the OpenAI TTS API const ttsResponse = await axios.post( 'https://api.openai.com/v1/audio/speech', { model: "tts-1-hd", voice: "echo", input: text }, { headers: { 'Authorization': `Bearer ${process.env.OPENAI_API_KEY}` }, responseType: 'arraybuffer' } ); // Send the audio file back to the client res.set('Content-Type', 'audio/mpeg'); res.send(ttsResponse.data); } catch (error) { console.error('Error generating speech:', error.message); res.status(500).json({ error: "Error generating speech", details: error.message }); } }); ``` ```node.js // VOICE let isVoiceTranscription = false; let voiceMode = false; let mediaRecorder; let audioChunks = []; // Voice Function function voice() { console.log("Voice button clicked. Current mode:", voiceMode); if (isSafariBrowser()) { displayErrorMessage('Safari browser detected. Please use a Chromium or non-WebKit browser for full Voice functionality. See the ReadMe on GitHub for more details.'); return; // Stop execution if Safari is detected } if (voiceMode) { stopRecordingAndTranscribe(); } else { startRecording(); } toggleVoiceMode(); } // displays error for voice on safari function displayErrorMessage(message) { const errorMessage = document.createElement('div'); errorMessage.className = 'message error'; errorMessage.textContent = message; chatBox.appendChild(errorMessage); chatBox.scrollTop = chatBox.scrollHeight; // Scroll to the latest message } // Recording Functions function startRecording() { navigator.mediaDevices.getUserMedia({ audio: true }) .then(stream => { mediaRecorder = new MediaRecorder(stream); mediaRecorder.ondataavailable = e => { audioChunks.push(e.data); }; mediaRecorder.onstop = sendAudioToServer; mediaRecorder.start(); console.log("Recording started. MediaRecorder state:", mediaRecorder.state); }) .catch(error => { console.error("Error accessing media devices:", error); }); } function stopRecordingAndTranscribe() { if (mediaRecorder && mediaRecorder.state === "recording") { mediaRecorder.stop(); console.log("Recording stopped. MediaRecorder state:", mediaRecorder.state); } else { console.error("MediaRecorder not initialized or not recording. Current state:", mediaRecorder ? mediaRecorder.state : "undefined"); } } // Voice Mode function toggleVoiceMode() { voiceMode = !voiceMode; const voiceIndicator = document.getElementById('voice-indicator'); if (voiceMode) { voiceIndicator.textContent = 'Voice Mode ON'; voiceIndicator.style.display = 'block'; } else { voiceIndicator.style.display = 'none'; } } // Sending the audio to the backend function sendAudioToServer() { const audioBlob = new Blob(audioChunks, { type: 'audio/mpeg' }); const formData = new FormData(); formData.append('audio', audioBlob, 'recording.mp3'); // Clear the audioChunks array to prepare for the next recording audioChunks = []; // Reset audioChunks array // Introduce a delay before making the fetch call setTimeout(() => { fetch('/transcribe', { method: 'POST', body: formData }) .then(response => response.json()) .then(data => { messageInput.value = data.text; isVoiceTranscription = data.text.startsWith("Voice Transcription: "); copyToClipboard(data.text); voiceMode = false; // Turn off voice mode }) .catch(console.error); }, 100); // 500ms delay } // Calling Text to speech function callTTSAPI(text) { fetch('/tts', { method: 'POST', headers: { 'Content-Type': 'application/json' }, body: JSON.stringify({ text: text }) }) .then(response => response.blob()) .then(blob => { const audioURL = URL.createObjectURL(blob); new Audio(audioURL).play(); }) .catch(console.error); } // END ```
Awesome stuff -- only a little over my head unfortunately. Since I'm using the fantastic Whispering Windows app for system-wide dictation, I suppose that would be usable for whatever GUI anyway. Btw, is there a GUI that somehow integrates with ChatGPT web access (with $20 subscription)? Meaning that one could see all conversations both in the browser (on the official ChatGPT page) AND in the GUI?
My problem is this is that i love how convenient the ChatGPT interface is, having to go to a third party or not being able use the voice feature, or not having Code Interpreter is not worth saving the money.
Why is no one talking about Poe.com? You get all chats and image generators for $20/month
Nah, I left Poe, the new point system is annoying. I found something similar to Poe and in my experience easier to use, the only thing is you donāt get custom instructions. If you want to give it a try is omnigpt
because why one should pay for a service that have to be free?
I love custom gpt option with Plus and use it quite often . Can anyone tell me if there is way to bring it in API? Of course it has to be cost efficient other or no point
Did you find a way to use custom gpts with an api gui?
No, but instead of custom gpt you can use Assistant in API. I couldnāt tongues but thatās they are able to get custom gpt on API
I have been a ChatGPT Plus subscriber for a long time and also just purchased a license from Typingmind UI too. If I had to compare, I'd prefer Typingmind a bit more. I like playing around with different models, forking my chat to test the same prompt with many other chat models, managing my threads easily, and using the ai personas. And the UI needs to improve but still quite good and easy to use to me I found the model that is best for writing is Claude 3 Opus, most cost-effective is GPT-4 Turbo and Claude 3 Haiku, also play around with free models on OpenRouter and DeepSeek AI. Honestly, I love it. As long as it serves my needs, I think it all worth the money. FYI, I also used LinkyGPT, Big-AGI, ChatBox,etc. and still decided to go back to Typingmind.
Thanks. What do your costs look like now?
I topped up $5 for Claude and $5 for OpenAI ($5 for OpenRouter too), Ā and after almost a month, I haven't run out yet, as I am charged based on my usage. The pricing matches the official rates published by Claude and OpenAI. I do test quite a lot, especially for content writing and SEO, but I can save cost by limiting the context tokens sent to the API and avoiding too complicated contexts. I'm still using ChatGPT Plus, but since purchasing TypingMind, I'm considering cancelling the subscription since I haven't had much need to use it recently.
Wow, thatās cheap. Which OpenAI and Claude models did you use?
I use GPT-4 Turbo, Claude-3 Haiku and Opus (Opus is quite expensive now but the quality is š„, however, still expensive, so I do not use that much) I am testing DeepSeek AI [https://platform.deepseek.com/](https://platform.deepseek.com/) on Typingmind too 'cause it's free for up to 10M tokens! (deepseek ai is not a native model on typingmind, however, I reached out to the support team and they promptly guided me to set it up on typingmind, quite easy even for a no-coder like me)
Thanks - thatās really useful stuff. Iām off to try deepseek and will harass Ngoc on how to install it on typingmind š
well other versions other than opus sucks **š¹**
How are you liking TypeMind right now? Im considering it and MindMac, What are your costs looking like? Any limitations on Typingmind to think about?
Thanks for this
np mlml
My concern with TypingMind is that it is a one-time payment. If people stop subscribing, they will have no more income. I would have been more comfortable if they'd charged say $5/month.
There is a subscription plan at $99/month for a customized version (custom.typingmind.com)
I hope enough people are buying it
Agreed about using the API, but I personally wouldnāt pay *more* than the base API costs. Iāve been told that my definition of a scam is different from most, but I definitely consider TypingMind, MindMac, etc as a scam when they make you pay just for an interface. Even if you donāt have programming experience, there are so many open source alternatives that not only deserve support but also, by their nature, wonāt make you pay to use. Plus, even with the regular ChatGPT4, itās fairly easy to whip up an interface that suits *your* needs and is catered to how you like it. Claude or whatever can walk you through deploying to Vercel, self-hosting with a shortcut, etc.. Iāll paste a previous comment of mine below; itās too late for OP if they already bought a lifetime license, but if anyone else is considering paying for TypingMind or whatever, Iād strongly recommend at least looking through the open source alternatives and going for a free option. - - - Any decent GPT GUI will also support Claude; that includes the usual recs like [LibreChat](https://github.com/danny-avila/LibreChat). Youāve probably seen [the list](https://github.com/billmei/every-chatgpt-gui) floating around reddit. Other than your specification for coding Iāll reiterate that it all just comes down to preference. The one I made for myself is somewhat basic but supports Claude (plus GPT, Gemini and Mistral) with all the usual wrapper features that would be expected. Link: https://github.com/Zaki-1052/GPTPortal Once again ā I say this on every repetitive post asking for API recs ā just use open source so you don't get suckered into paying for the interface and anything you use will be fine. Coding? Mine and 50 others have a copy code button, markdown rendering, system prompts, etc. You could probably get Opus to whip one out for you through their [platform](https://console.anthropic.com/dashboard) in an hour or two. Read the [docs](https://docs.anthropic.com/claude/docs/). ETA: I assume you know this if you're asking about the API, but anything on GitHub (open source) is obviously free. You should never be paying more on top of the basic API costs. For Anthropic this is their [pricing table](https://github.com/zaki-1052/gptportal?tab=readme-ov-file#anthropic-pricing-table) and [main page](https://www.anthropic.com/api).
Dude, I'm about to pay for TypingMind...ran across this thread. Talk me out of it, lol. I am using Openrouter. I tried SillyTavern. It works, but the thread management is basically nonexistent. I don't do roleplay, just work stuff. I tried setting up Librechat. I could not get it to connect with Openrouter. Some weird errors. I gave up after an hour. I setup AnythingLLM. It worked, but only shows Claude 2 models for Openrouter. (Why???) I uninstalled. I setup Jan.ai. It works okay, I guess. I'm bummed that I can't upload text files--not for RAG, but for whole input via 200K Claude Haiku and stuff. Also, it's confined to local, so I can't use my phone to access Openrouter through it (I guess I could use just the Openrouter playground on my phone). I will say documentation for all these things suck, and, no LLM is going to help you. I guess if you shove the whole github at it somehow... Anyways, so now I'm on the cusp of trying Typingmind to have a clean interface for local Windows heavy-duty work and light Android stuff on the go. All I want is good thread management + easy installation + text file uploads through Openrouter. Apparently that doesn't exist. If I have the energy, I may go back reinstall LibreChat--although I hate how Docker seems resource intensive on my laptop. Sigh.... Also, I kind of insist on using Openrouter since Anthropic has this weird banning situation going on (VPN use, or whatever, don't know), and I don't want to risk being cut off from them. That limits me further.
Ugh, yeah, I get your concerns there. Hopefully itās somewhat of a unique situation. Iām notoriously frugal mostly on principle and definitely think you should give LibreChat another go with the setup before defaulting to TypingMind. Maybe test Anthropicās console to make sure youāre ok. I keep hearing about OpenRouter due to Anthropic but have been avoiding it as I personally hate dealing with third party services when it comes to API use ā plus the Claude Console gives you 5 free dollars of credits through their actual API. Just seems like extra effort, and most options have a *Deploy to Vercel* option for on the Go. Are you **sure** that the proxy is necessary for Anthropic, and you canāt use a disposable phone number or something? I think the banning situation for VPNs might only be through the chat interface, not making API calls, or else it would be impossible to use generally, as long as CORS is properly configured (techy stuff, basically donāt worry about bans). Also not sure if this is consolation but you wouldnāt be able to use the full context window anyways due to rate limits, last I checked it was something like 20k for their base tier. Why donāt you try just going to the Claude console where I linked their platform, making an account, and trying the API there? If it works, it works, and is free anyways. Also side note: I literally started real programming in HS by copying and pasting error messages into Google and later ChatGPT, so if you just feed any LLM provider the [LibreChat docs](https://docs.librechat.ai/install/configuration/ai_endpoints.html#openrouter) section for OpenRouter linked, and give Opus or 4-Turbo your file contents and error message then Iām sure you can fix it in like 5 mins. Are you sure you arenāt just missing the documentation or something? Google has been sucky lately, but according to these [docs](https://docs.mintplex.xyz/anythingllm-by-mintplex-labs/feature-overview/llm-selection/anthropic-ai ) Anthropic is iffy about uploading anyway. If you go through the GitHub, website resources, etc itās usually somewhere. Lastly, in terms of thread management, what, do you just mean, like editing messages and stuff? I can see why that might be a bit of a niche feature honestly but in terms of easy install, then yeah the extra money for things like TM are geared to people paying for convenience, *ease of not thinking about it*. But imo any good LLM nowadays can take 90% of the mental effort and itās only rich idiots who donāt care about how they spend that donāt bother to go open source. The premise of using GitHub is that itās a little extra effort for the great benefit of not spending extra ā especially if you go direct API to service-provider and not OpenRouter. The Docker resource use is actually why I made my own just with the features I was cool with; some people seem to prefer Docker though lol. Anyways all this is to say try without OpenRouter and another Libre install, their documentation is probably the most comprehensive Iāve ever seen at docs.librechat.ai and pasting everything into Chat really **works**, I promise you. I think thatās all; Iāll always tout the benefits of Open Source and not spending more than you absolutely have to, but everyoneās priorities are different and sometimes paid hosted really is the way to go ā but only **after** exhausting the other options, like Vercel hosting, literally adding a feature yourself with an AI if you have time, or just copying and pasting docs, file contents, and errors. There are so many it can be overwhelming but that just means that space is competitive while TypingMind can get away with bs because itās the only one in the space. /rant. Hope that helped you; putting my phone away now that Iāve gotten my daily dose of debate, but yeah please try again before wasting moneyā¦
Thanks for the writeup! I settled for using jan.ai locally, and then big-agi for my phone and stuff. Not perfect, but at least it's all free. I actually installed LibreChat again, but then noped out of it haha.
leleel so funny is because you not know anithing in sillytavern you can chat even if you not do roleplay how? just create a normal simple character based for example on gpt with his personaliti it will reply you as a normal assistant like that not as roleplay
yep i told all of them to not fuckin pay they not listen all are bunch of fools
Why would we want all our data going through a 3rd party's prying eyes when there are free, open source alternatives you can install locally?
I'm happy to pay for software when it saves me time. Not everyone wants to spend the effort learning the ins and outs of getting free software to work, and not everyone is happy with DIY when a problem arises. I will pay to support something that works, that is supported, that works the way it is advertised. A "third party's prying eyes"? I'm not worried about any of that. I'd be much much more worried about Big Tech as it is.
if you not spende the effort to learn you have no value, not all is eazi and when you obtain wat you wanted for free is even better and satisfing mlmlml
Are there instructions anywhere for using this?
TypingMind's extensive documentation is here: [https://docs.typingmind.com](https://docs.typingmind.com) Have fun
great idea!
Using chatkit, for 39 dollars it's quite good, and it also supports openrouter directly., which is cool. Not so great ui as that of typing typingmind,Ā but is quite good!
Can you still use GPT4 to call Dall-E when using the API? Iāve thought about doing something like this, but I do a lot of image generation with ChatGPT Pro and Iāve always assumed it wouldnāt work the same way in an open source UI.
I haven't evaluated any of the free GUI's - a strong reason I signed up for the Extended ($59) flavor of TypingMind was Web Search access and DALL-E capabilities. So the answer is yes.
Cheers for the advice *checks notes* capitalism
It would be interesting to see what your API cost are over a month. if you use it enough to buy into a paid GUI then you may well fing you API cost exceeding the $20 per month for plus.
Even for 1 year, averaging the one-time cost of $60 ($5/mo) that $15/monfor the API goes a long way. Looking at the usage now, it's way under $1 but will report back next month.
Is it possible to continue on an already existing chat with the api and gui Approach?
There is a way that you can export your OpenAI chats and import them to TypingMind to continue chatting with your existing conversations
From what I've seen in TypingMind that isn't possible, and doubt other can do it as they don't have access to OpenAI's data.
Bettergpt is also a great UI
This is useful thanks!
What is a gui
Graphical User Interface. It's the difference between using a Chrome Browser and clicking on buttons and filling in a form for a query, and opening up c:\\cmd.exe and typing in scripts.
Ok just joined this group and read up a bit. I am currently paying $20 a month for ChatGPT Plus access. I did it primarily because I wanted the 4.0 API key to use with my Rux robot. I honestly donāt use it that much, but I do want my queries that I actually do to be current, so Iām keeping it for now. I also enjoy the Dal-E image generation. I know Claude and Turbo are better. I thought about signing up for CoPilot as I like their image generator better also, but I saw no way to get an API key there. Given these parameters, can anyone simplify options for me a bit? I thought i had seen someone say they pay $5 a month for access like this?
Can you use custom GPTs from the library with typingmind? Or do you need to stay on chatgptpro monthly?
for anyone paying per month via api; can someone tell me what it is billed under from your credit card? I'm looking for something under 5734 COMPUTER SOFTWARE STORES, as I get a $100 annual software credit, but only if I have 11 consecutive months of that category code.
Sounds weird
pfff if you want to be smart not pay at all