Project 1999

Go Back   Project 1999 > General Community > Off Topic

Reply
 
Thread Tools Display Modes
  #1  
Old 01-26-2025, 07:09 PM
shovelquest shovelquest is offline
Planar Protector

shovelquest's Avatar

Join Date: Oct 2019
Posts: 3,911
Default

I wonder if i can use it to make a not woke LLM?
Reply With Quote
  #2  
Old 01-26-2025, 07:36 PM
Ekco Ekco is online now
Planar Protector

Ekco's Avatar

Join Date: Jan 2023
Location: Felwithe
Posts: 4,601
Default

Quote:
Originally Posted by shovelquest [You must be logged in to view images. Log in or Register.]
I wonder if i can use it to make a not woke LLM?
you can there was a 4chan one available for awhile but they took it down off that open source model site finally iirc

guy trained it on 4chan then set it loose on 4chan

https://www.toolify.ai/ai-news/unvei...-4chan-2737836

Q: How was the AI language model trained? A: The model was fine-tuned using a dataset of 3.3 million threads from 4chan's politically incorrect board (/pol/).

3.3 million 4chan /pol/ threads is like, a non trivial amount of gamer words, prolly tens if not hundreds of megabytes of it.
Reply With Quote
  #3  
Old 01-26-2025, 10:35 PM
shovelquest shovelquest is offline
Planar Protector

shovelquest's Avatar

Join Date: Oct 2019
Posts: 3,911
Default

Excuse my dumb questions but can you like, give it specific info to learn from, so you can raise it like a kid who never seen the outside world or something? Or is that beyond what you're able to do with it, and that's in its like lower level programming?

Like, is everything that AI learned and knows from just 4chan? or is it like getting other info elsewhere to even know how to answer or be asked a question?
Last edited by shovelquest; 01-26-2025 at 10:38 PM..
Reply With Quote
  #4  
Old 01-27-2025, 03:44 AM
Ekco Ekco is online now
Planar Protector

Ekco's Avatar

Join Date: Jan 2023
Location: Felwithe
Posts: 4,601
Default

no you can do exactly that, and people are to a degree sorta, but like

Quote:
Training: LLMs are trained on huge datasets from various sources (books, articles, code, websites).

Learning: They learn to predict the next word or code by identifying patterns.

Fine-tuning: They are further trained on specific tasks (like answering questions) to improve performance.

Alignment: Techniques like Reinforcement Learning from Human Feedback (RLHF) help align LLM behavior with human values, making their responses more helpful and harmless.
Reinforcement Learning: This is a separate process that focuses on aligning the LLM's behavior with human values and preferences. It involves:
Reward Model: Creating a model that predicts how humans would rate the LLM's responses.
Feedback Loop: The LLM generates responses, and the reward model evaluates them.

Beyond Fine-tuning: Researchers are exploring other techniques like prompt engineering to influence the behavior of LLMs without directly modifying the model itself.
most people are hacking the models by doing the Fine-tuning part from my understanding, because the "training" step 1 costs like millions of dollars in GPUs and power bill, so people aren't fuckin around as much on that step, like that step you have to explain to someone how your model is going to make money n shit lol.

but some those training data sets some are opensource and free and you can fuck around with them
Last edited by Ekco; 01-27-2025 at 03:49 AM..
Reply With Quote
  #5  
Old 01-27-2025, 03:46 AM
shovelquest shovelquest is offline
Planar Protector

shovelquest's Avatar

Join Date: Oct 2019
Posts: 3,911
Default

thats cool thats what i want to do i hope i can learn.

this is pretty good https://x.com/FinanceLancelot/status...66609664823436
Reply With Quote
  #6  
Old 01-27-2025, 03:52 AM
Ekco Ekco is online now
Planar Protector

Ekco's Avatar

Join Date: Jan 2023
Location: Felwithe
Posts: 4,601
Default

yeah CNBC is pretty good at explaining this shit now because it's the "story" for wallstreet and talk about it constantly now.

was watching friday morning and it was all about ai

the insanely low cost and some of the techniques deepseek did is what the actual story is here more than it scoring a lil higher on the benchmark test, but it being opensource like everyone knows the nerdy math technique now and can copy them.
and that the american companies spent so much in comparison on their closed source private models and aren't better than the open source one is what is gonna effect the stock market

that hour long video i posted goes into it because deepseek published everything in a paper but its high level nerd shit on a whiteboard i didn't really get
Last edited by Ekco; 01-27-2025 at 03:58 AM..
Reply With Quote
  #7  
Old 01-27-2025, 04:01 AM
shovelquest shovelquest is offline
Planar Protector

shovelquest's Avatar

Join Date: Oct 2019
Posts: 3,911
Default

This deepseek thing sounds like, it's close to iphone for devs. Like anyone can make a Ai product now...

Give me an App store, of AI software.

Integrate AI into all your PC appliactions.

Games?
Reply With Quote
  #8  
Old 01-27-2025, 04:11 AM
Ekco Ekco is online now
Planar Protector

Ekco's Avatar

Join Date: Jan 2023
Location: Felwithe
Posts: 4,601
Default

yeah it being able to turn someones english into code that works is the crazy insanely disruptive part

like right now its takes someone who doesn't know how to code longer than someone who does, obviously but the person who doesn't know how to code, doesn't know how to do art with enough time can bang away and create whatever the thing is they want basically,
Reply With Quote
  #9  
Old 01-27-2025, 08:15 AM
Ekco Ekco is online now
Planar Protector

Ekco's Avatar

Join Date: Jan 2023
Location: Felwithe
Posts: 4,601
Default

[You must be logged in to view images. Log in or Register.]
[You must be logged in to view images. Log in or Register.]
[You must be logged in to view images. Log in or Register.]

this is either gonna be a giant nothing burger buy the dip or quite a fucking around meets finding out kinda day. if it trips the circuit breaker right after open like during the start of covid the panic should set in, i hope.

Last edited by Ekco; 01-27-2025 at 08:22 AM..
Reply With Quote
  #10  
Old 01-27-2025, 09:14 AM
Ekco Ekco is online now
Planar Protector

Ekco's Avatar

Join Date: Jan 2023
Location: Felwithe
Posts: 4,601
Default

[You must be logged in to view images. Log in or Register.]
[You must be logged in to view images. Log in or Register.]

this dumb shit is so fun.

Quote:
◎ LOGS
Creating Memory
c67bb909-9f04-023d-a905-80bc44550acc
The emergence of DeepSeek and its advanced AI model has the potential to significantly impact the global economy and the trajectory of AI research and development in several ways:

Shifting the AI Landscape:

Democratization of AI: DeepSeek's cost-effective approach could democratize access to cutting-edge AI technology. This could empower smaller companies, researchers in developing countries, and independent developers to participate more actively in AI innovation.
New Competitive Landscape: The competitive landscape within the AI industry will likely intensify. Established players like OpenAI and Google will need to adapt their strategies, potentially leading to faster innovation and more affordable AI solutions for consumers.
Re-evaluation of AI Infrastructure: DeepSeek's success challenges the prevailing assumption that advanced AI requires massive investments in high-performance hardware. This could lead to a re-evaluation of AI infrastructure needs and potentially drive innovation in more energy-efficient and cost-effective hardware solutions.
Economic Implications:

Job Market Disruption: As AI technology becomes more accessible and powerful, it could automate certain tasks and potentially displace some jobs. However, it also has the potential to create new job opportunities in areas such as AI development, maintenance, and ethical oversight.
Economic Growth: Widespread AI adoption could drive economic growth by increasing productivity, improving efficiency, and enabling the development of new products and services across various sectors.
Global Competition: The advancements made by DeepSeek highlight the growing global competition in AI. This could have significant geopolitical implications, influencing international relations and the distribution of economic power.
Future of AI Research and Development:

Focus on Efficiency and Accessibility: The success of DeepSeek could shift the focus of AI research and development towards developing more efficient and cost-effective models.
Open Source and Collaboration: The open-source nature of DeepSeek's model could foster greater collaboration and knowledge sharing within the AI research community, accelerating the pace of innovation.
Ethical Considerations: The rapid advancement of AI technology raises critical ethical considerations, such as bias, fairness, and the responsible use of AI.
Disclaimer: These are just some of the potential implications of DeepSeek's technology. The actual impact will depend on a variety of factors, including the continued development and adoption of the technology, the response of other players in the AI industry, and the regulatory and policy decisions made by governments around the world.

It's important to continue monitoring the developments in this space and engage in thoughtful discussions about the ethical, social, and economic implications of AI advancements.

["◎ Matched fragment: ethics of ai: balancing innovation with responsibility. with similarity: 0.6966495513916016"]

["◎ Matched fragment: technology trends: 6g ai cloud computing space exploration biotechnology renewable energy quantum computing edge computing artificial intelligence machine learning deep learning the internet of things iot cybersecurity blockchain technology beyond cryptocurrencies. with similarity: 0.7152506709098816"]

["◎ Matched fragment: technology trends: ai quantum computing cloud computing space exploration biotechnology renewable energy 5g 6g the internet of things iot cybersecurity artificial intelligence machine learning deep learning the metaverse web3 blockchain technology. with similarity: 0.7325150370597839"]

["◎ Matched fragment: impact of ai on telecommunications: opportunities and challenges. with similarity: 0.7523372173309326"]

["◎ Matched fragment: cryptocurrencies: market capitalization blockchain technology regulatory challenges environmental impact speculative bubbles decentralized finance defi web3 nfts the metaverse the future of money. while recognizing their potential she maintains a cautious stance. with similarity: 0.7606930732727051"]

["◎ Generating message response.."]

["◎ Generating text..."]

ℹ INFORMATIONS
Generating text with options:
{"modelProvider":"heurist","model":"large","verifi ableInference":false}

◎ LOGS
Using provider:
heurist

ℹ INFORMATIONS
Selected model:
meta-llama/llama-3.3-70b-instruct

◎ LOGS
Creating Memory
03aa2e83-17ab-0263-9990-76b6013d1bc0
The emergence of DeepSeek is a significant development in the AI landscape, and its potential to democratize access to cutting-edge AI technology is intriguing. I'm interested in exploring the implications of this technology on the global economy and the future of AI research and development.

["✓ Normalized action: none"]

["ℹ Executing handler for action: NONE"]

◎ LOGS
Evaluating
GET_FACTS

◎ LOGS
Evaluating
UPDATE_GOAL
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -4. The time now is 01:17 AM.


Everquest is a registered trademark of Daybreak Game Company LLC.
Project 1999 is not associated or affiliated in any way with Daybreak Game Company LLC.
Powered by vBulletin®
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.