Spaces:
Running
Getting garbled or nonsensical responses
Hello,
I tried to ask questions based on the given context. For the first couple of chats, LLM gives nearly correct answers, but after that it starts giving nonsensical and hallucinations. Is it stateless? See the text below -
oriding or so their to to to orpping holations to to to to to to to to highway or the “including their or including g and federal or toge or the to to to to to to to to to to to their to so to low or or so to to to to to or to to to to to oriding or g to violiding oror,or or to, to to to to to buming to or or or to to to to to to to or to to toor to crossiding to to low cross or holumsom to to to their to the to hol or the pass cross passomiding “hol cross or viol crossing to cross or or so viol so or thenations or mid or soll cross or violir hol or their to so hol or holding b or middle paid arbitr cross to to to to to mid to mid so b ho or or or low or high or cross high high or mid over or toirs so them or pay so to or lower or so cross highway orided or or low or crossing oriding or to to covered covered dem mid fast affed to so highs cross from or hooks so crossing paid or cit covered low reported orides or covered cross to to toicided cross crossides to to to cross pass soides fer cross cross vis so cross midming to rids mididesides so to crossives to to to to so traffic from so from so so for or or lower or so or so their so so to to or hall soives or so cross so can so so and or oralsides for soes ar or so soidesants soic so or so soalsidesives or or or or midomides so so and so to to or to so so or to to to to to so midally so for g their for so or or or G scratchsides so so a so denive hall so so soides so or or so mid or their so so so middle or hook mid so except so minor or so soging middle or soides, soiden so soants soider so so middle soive so soide sociotdingively so so so or so midides soider soider or so so and or so so so so so soferiderfer but so socul so but so so so soideated so so so sofer so so so so so so so soiders so soider crossive so so so so so so drago so sofer so so the stated so so so or so southern soides so so so so so drag so so but over or or or so drag except so so arm arm drag over so so so described represented held so the so so so soiders so sofer, so, so so so so so so so sodersci over so so over represented so so so so or so holo or so or so so major or holiced soically soioci soferofer so soomids soock so so soci so so soider dragix soci as soil drag hookic very very dragicapci with bidideide dragze soave dragicideile or dragive orived hookowed soive very dragiation so hoide are areoide or des so dragize orides oro soide sooive overalsulideotide orignideineoiding soil hook soidehooileoideoferferice overave crossived to to sooidero sooulideroideoferirive for forzingivezectoricoicideraeferoicixoferideiceidecedize soify soize so so so soixulululider for soilivezying theoixferix soomeixeiro parkomuroilzyoferoideoferoiseurilirferoferixoineoixoctoroferoillirooiririreoferoterize asayoiro theiveoofer the to the the soix the the soomixoilcerooferixctorineir sooile socedo soeired. of cit sole butoilil the the so soineilfer so soome soix nor soctorideoime soile so socedice soicle soil, so so, soilferoide, sohoo so soe socedoile soueoome soo so so soicoferixiate to to to to toice to to to to to to so sooicific holo soixicequesoile so to too tooimeoomferoizeo to toileayekic to to toeoideicoferoctor, soideize, so soize overide overice, holify,hooixicidericuldomideile, low hohlile hy ferile bimeiricired,soo tooiseided to
SAME THING HAPPEN TO ME LOL!
i had it arguing with me about a website it swears exists, but when i checked and googled around the name, it does not
i said as much, and it argued with me that it was not hallucinating, that it was a real site, etc
really stuck to it's guns, despite all argument and evidence, and tbh got a bit gaslighty while talking about it
You have to prepare prompt and be patient in your testing, as this is model that can be used for various other applications in free software. Though this is useful model, but you can think of other models being only for research and not deployment purposes. It just created speedy and very correct story for me. You have to find uses for the LLM, especially if they are tiny:
- Phi-3.5-mini answers most correctly and works well, though not so fast;
- Rocket-3B is working well;
- TinyLLama may have it's uses to generate keywords, rewrite text paragraphs, etc.
- IBM Granite
- Qwen versions
All those offer various free software models, and I do not use them for same purposes. It requires testing of course. In one year and 3 days I have logged 6353 requests and there may be as much more not logged, that is probably 12,000 LLM requests and responses which then give me sense of how I can use some model and for which purpose.
Each time I change the purpose, I am also testing the model.
If model is fast and can rewrite my paragraph, then why not, then I will take fastest one that can do it.
So my mind moves to various tasks which are usually batch tasks, then I try out some models if they are suitable for the task, those which are suitable, I let them run and run.