We don’t know what quantization level was used for the weights or the kv cache for you or for parent poster, so this is probably an apples to oranges comparison.
The KV cache is probably offloaded to RAM after a generation is complete. Then it is pulled back into any rack in the data center that has the model you’re using.
Klipsch was famous for making speakers using acoustic horns, which was somewhat esoteric. When they finally made a speaker which used a conventional woofer, they named it “the heresy”.
A 3dfx card running in an O2 surely deserves a similar moniker :)
But, as we learned with the telnet filter going into place, we exist on the network at the pleasure of everyone else. Their concerns must come before ours. The needs of the many outweigh the needs of the few.
Not OP, but when I got glasses as an adult and while they really improved the sharpness of my vision I could feel my unassisted vision getting worse, so I stopped using them and get by with slightly unfocused but unassisted vision. I assume if I wore them full time my unassisted vision would degrade to the point where I then need the glasses full time.
I got glasses 2 years ago for a very minor prescription. Your eyesight sucked before you’ve just forgotten how badly. I had an eye test very recently for
Contacts and my prescription is the same 2 years later
I've got half a diopter (ish) of astigmatism in my right eye and it can be slightly annoying but interesting to know that using glasses would risk making it worse.
The weird thing is it seems to get noticeably worse or better depending on how much time I spend outside
I meant that once you decide to wear prescription optics you can’t go back to not wearing them, of course excluding eye surgery. In my case I could stick to good enough vision and luckily 20 years later Im still not wearing glasses. My main point was that I was getting eye strain from blue light and once I reduced it the problem dissapeared.
This isn’t true? Myopia develops rapidly in youth then stabilizes in adulthood. It gets a worse with age, not corrective lenses. Then sometime after 40 you flip to presbyopia when your lenses lose flexibility.
I don't have severe myopia and I'm fine with no glasses for now. The optometrist detected .5 correction needed but advised me to not go for it for the reason I mentioned. I think they are more qualified to give this advice than some rando on the internet. If they were a mercenary they'd tell me to go for it, that optometry practice was part of an eye glasses store and I'm sure they'd gain from my business there. And here I am 20 years later not wearing glasses yet. As I'm getting older my vision is getting slightly worse, I'll probably get to wear them at some point but that's beside the point.
There is plenty of information about this in trusted sources, the way you're describing this is incorrect. Overcorrection and badly designed simplistic optics can make myopia worse in childhood when the eye is growing. Your eye is no longer growing.
Don't trust everything your doctor says verbatim, they often oversimplify and their information can be out of date. Give your doctor the benefit of the doubt but check it against other sources and use it to build a mental model.
I would guess that most folks would consider a bunch of problem prompts with no reference solutions to be not so useful. How would you check your understanding? How would you know if you were writing go code which would be frowned upon by industry veterans?
And on top of that, putting these in AGENTS.md makes no sense whatsoever. You’ll simply waste tokens and confuse the hell out of your agents. I wonder if gp assumed this is another repo of design patterns without reading anything there at all. Pasting a bunch of design patterns into AGENTS.md may not be the brightest idea either but at least that isn’t absurd.
I think it has more to do with the fact that when you offer zero salary for moderators, you have to take what you can get, and it ain't good. I don't really see a connection to the voting mechanic.
It's also disconnected incentives. SO users get numbers to go up by taking moderation actions so of course they do that. Also you literally get banned from reviewing questions if you don't flag enough of them to be closed. These are incentives put in place by the SO company intentionally.
It's not like only slimy people get to use moderator tools like on Reddit, since you need a lot of reputation points you get by having questions and answers voted up. It's more like (1) you select people who write surface-level-good answers since that's what's upvoted, and they moderate with a similar attitude and (2) once you have access to moderator tools you're forced to conform with (1) or your access is revoked, and (3) the company is completely incompetent and doesn't give a shit about any of this.
Why do you think it makes a difference if they are paid or not? Or more to the point: what are you saying? That people have different standards when paid? That lack of remuneration justifies poor effort? Isn’t that a very transactional view of human interaction? Are we that transactional? Do we want this?
We’re talking about how communities can become toxic. How we humans sometimes create an environment that is at odds with our intentions. Or at least what we outwardly claim to be our intentions.
I think it is a bit sad when people feel they have to be compensated to not let a community deteriorate.
> That people have different standards when paid? That lack of remuneration justifies poor effort? Isn’t that a very transactional view of human interaction? Are we that transactional?
The answer to all of these questions is yes, for the most part. Volunteers are much harder to wrangle than employees and it's much easier for drama and disagreements to flare when there are zero consequences other than losing an unpaid position, particularly if anonymity is in the mix.
Volunteers can be great but on average they're going to be far harder to manage and far more fickle than employees.
Then you have a much darker view of humanity than I have. What you seem to suggest is that because building a community on volunteers is hard it is not worth doing.
What makes a community worthwhile is its ability to resolve differences productively. I think that if you replace individual responsibility with transactionality you have neither community nor long term viability or scalability.
Then again, we live in times when transactional thinking seems to dominate discourse.
It's because I was involved with a large volunteer-based project that was a literal 24/7/365 operation for several years (dozens of volunteers at any given time and tens of thousands of concurrent users) and can speak first hand as to the differences.
I didn't say it's not worth doing but it will bring challenges that wouldn't exist with employees. Paying people adds a strong motivator to keep toxic behaviour at bay.
Your experiences will heavily depend on the type of project you're running but regardless, you can't hold volunteers, especially online, to the same expectations or standards as employees. The amount of time and effort they can invest will wax and wane and there's nothing you can do about it. Anonymity and lack of repercussions will eventually lead to drama or power struggles when a volunteer steps out of line in a way that they wouldn't in paid employment. There is no fix that'll stop occasional turbulence, it's just the way it is. Not all of your volunteers will be there for the greater good of your community.
Again, that is absolutely not to say that it can't be worth the effort but if you go into it eyes open, you'll have a much better time and be able to do a better job at heading off problems.
I've seen other people express similar opinions to yours and it wasn't until they experienced being in the driver's seat that they understood how difficult it is.
