Hi, this is Vipul, I am a co-founder of Together. We plan to release the model weights under Apache 2.0. The amount of creativity that Stable Diffusion unleashed for instance is only really possible with permissive licenses!
Thank you Vipul, you and the others are really doing god’s work and have the full support of myself and my academic research team, who are eager to push the boundaries with data, prompts, and investigations of whatever you release (in fact, we have spent the last couple of months working to produce multi-lingual prompts and enriching the few open models we had so far). Just a very quick point of feedback.
While I am not a lawyer and Apache 2.0 is likely to be unproblematic, I always find it puzzling as to why people recently are opting to license non-software using software licenses (Apache 2.0 in particular). Hopefully you have access to sensible lawyers, but I was always under the expectation that model weights would fall under a license such as CC-BY rather than Apache 2.0. Sadly it has been too long since I read the recommendations and justifications for this, so I can not find a good reference, but seem to recall the advice came out of FSF.
Are you working at all with Stability, Eleuther, or LAION? There have been some rumors that they are doing something similar to this and I'm wondering if this is a duplicated effort.
Either way, huge fan, it would be awesome to have a LLaMA set of weights that are fully open.
We are appreciative to the work done by the growing open-source AI community that made this project possible.
That includes:
Participants in building the RedPajama dataset including […] LAION.
Meta AI — […].
EleutherAI — This project is built on the backs of the great team at EleutherAI — including the source code they provided for training GPT-NeoX.
An award of computer time was provided by the INCITE program. This research also used resources of the Oak Ridge Leadership Computing Facility (OLCF), which is a DOE Office of Science User Facility supported under Contract DE-AC05-00OR22725.”
The answer to your question is right there at the bottom of the page in the linked-to blog post :/
A very similar thing happened to me when I was pitching Gmail on anti-spam and realized they were running a forked version of Vipul’s Razor and claiming it was their own. They never contributed anything back... it’s unfortunately not uncommon.
Not sure which problem you are referring to and would like to hear more. It’s cool that you can go to a website, spend 5 mins to fill out a form and start getting emission free power. A good step in the right direction.
These are almost completely wrong. The goal of AC is to get to “what I meant to type” and good AC systems are designed with priors (eg frequency), common spelling mistakes, etc in mind.
If you think that design/redesign is a waste of time, a good exercise would be to try and understand why fashion constantly evolves, ie why you no longer see people in bellbottoms and corsets.
I value design, like I pointed out earlier. What I find lacking in value are total redesigns where there isn't concrete reasons why the redesign should take place. For what basis is the redesign on? It "feels" better?
I'd be more comfortable with a more complete reason.
Background music is a very tough business. This article was focused on the custom and boutique programming end for highly brand conscience clients. I co-founded Trusonic and competed with Muzak and DMX for several years eventually servicing 50,000 locations. It is a competitive business at scale. There are companies that are willing to pay top dollar for music programmers who will completely customize playlists for a brand, but these are somewhat rare and not necessarily the business one looks to engage due to the labor required.
In 2000, I managed to put together $ for a US trip from India to attend YAPC (Yet Another Perl Conference) at CMU. I had been on #perl for years, and knew a lot of rhe community, but I had never spoken with Larry. I remember I was given a shared dorm room (even though I had requested a single), and as I was settling in, this guy in all black walks in, and says hi I am Larry, I am your roommate. I was like hey Larry, and went back to unpacking, and in about a minute realized it was _the_ Larry. It was awesome as Larry then took me around the conference and introduced me to many of the other legendary Perlers. A+ dude.
