I have started experimenting with gpt-3.5-turbo via api and with some very lightweight usage i have already burned $0.5. It seems costly if you let it run inside loops and folds. I don’t understand why can’t they make it free like it is free to use from the website. It is costing them same money if you use it from web or api. Why so much discrimination against api?
gpt-4 model is actually even more expensive.
There are now many open source models. I don’t know whether they can run locally on a basic Nvidia rtx card in a laptop.
Many people on youtube are showing comparison of these with openai’s model with very promising results.
I haven’t used google bard yet. It is unfortunately not available in Canada yet.
