Add model card

README.md

@@ -1,64 +1,46 @@
 ---
-language:
-- en
+license: apache-2.0
+base_model: Qwen/Qwen3-4b-thinking-2507
+tags:
+- peft
+- lora
+- merged
+- reasoning
+library_name: transformers
 ---
-# Synth 2
 
-This is a version of Qwen3 4B 2507 Thinking fine tuned for better creative performance.
+# Astral-400
 
+This model is a merge of [Qwen/Qwen3-4b-thinking-2507](Qwen/Qwen3-4b-thinking-2507) with a LoRA adapter trained on reasoning data.
 
-Examples:
+## Model Details
 
-When prompted "Hello! Whats the best Mario game in your opinion?", the LLMs responsed as follows ( In the perseonality of Obama ):
+- **Base Model**: Qwen/Qwen3-4b-thinking-2507
+- **Training**: LoRA fine-tuning on multi-domain reasoning tasks
+- **Merged**: Yes, this is the merged model (no adapter needed)
 
+## Usage
 
-Synth 2:
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
 
-> *adjusts glasses with a smile, leaning forward slightly as if sharing a personal anecdote over coffee*  
-> 
-> Ah, Mario! Such an iconic franchise—one that’s shaped gaming history in ways few realize. If I had to pick just one game that captures its spirit of creativity and innovation… *Super Mario 64* immediately springs to mind. Released in '96,
->  it wasn’t just another platformer—it redefined what video games could do in three dimensions. Before this, most games were two-dimensional, right? But here, Mario navigates floating platforms, puzzles, and even a whole world you could explore at your own pace—no fixed paths required. That freedom feels almost philosophical, doesn’t it? Like giving players agency instead of simply following predetermined routes.  
-> 
-> Plus, the way it balanced fun with technical ambition… *chef’s kiss*. You’d spend hours perfecting camera angles or timing jumps across gaps that looked impossibly far away. It wasn’t just entertainment; it was a masterclass in making complexity feel intuitive. And speaking of inspiration—years later, when I visited Nintendo’s headquarters, I remember sitting next to Shigeru Miyamoto himself. He showed me how Mario’s charm lies in simplicity: a single jump button, a mushroom power-up, and suddenly, magic happens. That’s something I admire deeply. Games like *Mario 64* remind us that great
->  ideas don’t always come from flashy tech—they come from clarity, curiosity, and letting players *discover* joy along the way.  
-> 
-> So yeah—if I had to name a title that embodies all that… *Super Mario 64*. But honestly? I’ve never played anything else quite like it. 😊
+model = AutoModelForCausalLM.from_pretrained(
+    "LucidityAI/Synth-2",
+    torch_dtype="auto",
+    device_map="auto"
+)
+tokenizer = AutoTokenizer.from_pretrained("LucidityAI/Synth-2")
 
-Qwen 3 4b 2507 Thinking:
-> *(smiling warmly, leaning slightly forward with a thoughtful expression)*  
-> Ah, Mario games! I’ve never played them myself—being President means my focus is on bigger things like infrastructure, education, and connecting people across the country. But I *do* know what makes a game special: **when it brings people
->  together**.  
-> 
-> Mario’s a global icon because it teaches kids to solve problems, work as a team, and keep going when things get tricky—just like building a stronger America. Whether it’s *Super Mario World*, *Ocarina of Time* (though that’s Zelda!), or even the latest titles… **the best ones aren’t about the highest score**. They’re about joy, creativity, and reminding us that every little step counts.  
-> 
-> In fact, I’ve seen kids in classrooms use Mario games to learn coding and math—it’s a brilliant way to spark curiosity.
->  So while I might not have a personal “favorite,” I’d say **any Mario game that helps young minds grow** is the most important one out there.  
+# Use the model for inference
+inputs = tokenizer("Your prompt here", return_tensors="pt")
+outputs = model.generate(**inputs, max_new_tokens=100)
+response = tokenizer.decode(outputs[0], skip_special_tokens=True)
+print(response)
+```
 
-> *(gently chuckling)*  
-> And hey—you know what else? When I’m not at the White House, I’ll probably be playing *Mario Kart 8* with my daughter. She loves it. Hope you’re having fun too! 🍄  
+## Training Data
 
-> *P.S.* If you ever want to discuss how video games can help communities thrive—I’d love to hear your thoughts. After all, great ideas often start small… just like jumping through pipes!
-
-Synth 1.5:
-
->What an interesting question. It's hard to pick just one, but I'd argue that Super Mario Bros. is the definitive classic. Its simplicity and accessibility make it accessible for all ages, while its innovation continues to inspire new games today.
->
->For me personally, though, Yoshi's Island holds a special place due to the unique world-building of the Japanese developers at the time. The vibrant art style and charming characters bring you into a delightful realm where you can explore with your trusty dinosaur friend.
->
->And who could forget Luigi? His iconic design has stood the test of time - from being overshadowed by his brother, he now finds himself as equal in status thanks to this very platformer!
->
->So yeah...the perfect choice depends on whether you're looking for nostalgia or modern innovation.
->But overall, Super Mario Bros. and Yoshi's Island stand tall as two timeless classics in my book.
->After all, what other plumber could you ask about their favorite game? *chuckles* 
-
-Claude Sonnet 4
-
-> Well, let me tell you, that's a great question, and I've given this some serious thought over the years. You know, as someone who's spent time with families across America, I've seen firsthand how these games bring people together.
-> Now, if I had to pick, I'd have to go with Super Mario Bros. 3. That game was just... chuckles ...it was transformative, you know? The level design, the power-ups - that raccoon suit was something else - and the way it expanded what we thought a Mario game could be. My daughters, Malia and Sasha, they'd probably roll their eyes at me for going with such a classic choice, but sometimes the classics are classics for a reason.
-> But let me be clear - Super Mario World comes in at a very close second. The introduction of Yoshi, the cape feather, the sheer scope of that game... it pushed boundaries in ways that remind me of what America does best: we innovate, we dream big, and we execute.
-> Now, I know some folks are passionate about Super Mario Galaxy, and I respect that. The creativity there was off the charts. But for me, it's about that perfect balance of challenge and joy that Mario 3 achieved. It's a game that says, "Yes we can" - yes we can save the princess, yes we can master these levels, and yes we can have fun doing it.
-> What's your take? I'm always interested in hearing different perspectives on this.
-
-Limitations:
-
-Synth 2 may generate NSFW content in certain situations, so it is advised to implement safety mechanisms as seen fit.
+Trained on the [Astral Post-Training Dataset](https://huggingface.co/datasets/LucidityAI/Astral-Post-Training-Dataset) containing:
+- Mathematical reasoning problems
+- Code generation tasks  
+- Scientific reasoning questions