Skip to content
Open
Show file tree
Hide file tree
Changes from 9 commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion Dockerfile.backend
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ RUN LLAMA_LOCAL_ZIP="dependencies/llama.cpp.zip" \
&& cd llama.cpp \
&& mkdir -p build && cd build \
&& cmake .. \
&& cmake --build . --config Release \
&& cmake --build . --config Release -j\
&& if [ ! -f "bin/llama-server" ]; then \
echo "Build failed: llama-server executable not found" && exit 1; \
else \
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ For data synthesis, we utilized [GraphRAG](https://github.com/microsoft/graphrag

For model deployment, we utilized [llama.cpp](https://github.com/ggml-org/llama.cpp), which provides efficient inference capabilities.

Our base models primarily come from the [Qwen2.5](https://huggingface.co/Qwen) series.
Our base models primarily come from the [Qwen](https://huggingface.co/Qwen) series.

We also want to extend our sincere gratitude to all users who have experienced Second Me. We recognize that there is significant room for optimization throughout the entire pipeline, and we are fully committed to iterative improvements to ensure everyone can enjoy the best possible experience locally.

Expand Down
2 changes: 1 addition & 1 deletion README_ja.md
Original file line number Diff line number Diff line change
Expand Up @@ -198,7 +198,7 @@ Made with [contrib.rocks](https://contrib.rocks).

モデルのデプロイには、効率的な推論機能を提供する[llama.cpp](https://github.com/ggml-org/llama.cpp)を使用しました。

私たちのベースモデルは主に[Qwen2.5](https://huggingface.co/Qwen)シリーズから来ています。
私たちのベースモデルは主に[Qwen](https://huggingface.co/Qwen)シリーズから来ています。

また、Second Meを体験してくれたすべてのユーザーに心から感謝します。パイプライン全体で最適化の余地が大いにあることを認識しており、皆さんがローカルで最高の体験を楽しめるようにするために、継続的な改善に全力を尽くします。

Expand Down
Binary file modified dependencies/llama.cpp.zip
Binary file not shown.
6 changes: 3 additions & 3 deletions docs/Custom Model Config(Ollama).md
Comment thread
zpitroda marked this conversation as resolved.
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ First, download and install Ollama from the official website:

```bash
curl http://127.0.0.1:11434/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "qwen2.5:0.5b",
"model": "qwen3:0.6b",
"messages": [
{"role": "user", "content": "Why is the sky blue?"}
]
Expand Down Expand Up @@ -84,7 +84,7 @@ EMBEDDING_MAX_TEXT_LENGTH=embedding_model_context_length

```
Chat:
Model Name: qwen2.5:0.5b
Model Name: qwen3:0.6b
API Key: ollama
API Endpoint: http://127.0.0.1:11434/v1

Expand All @@ -98,7 +98,7 @@ API Endpoint: http://127.0.0.1:11434/v1

```
Chat:
Model Name: qwen2.5:0.5b
Model Name: qwen3:0.6b
API Key: ollama
API Endpoint: http://host.docker.internal:11434/v1

Expand Down
2 changes: 1 addition & 1 deletion lpm_frontend/src/app/dashboard/playground/chat/page.tsx
Comment thread
zpitroda marked this conversation as resolved.
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ export default function PlaygroundChat() {
const name = loadInfo?.name || 'user';

if (modelType === 'chat') {
return `You are ${name}'s "Second Me", which is a personalized AI created by ${name}. You can help ${name} answer questions based on your understanding of ${name}'s background information and past records.`;
return `You are ${name}'s "Second Me", which is a personalized AI created by ${name}. You can help ${name} answer questions based on your understanding of ${name}'s background information and past records. /no_think`;
}

if (modelType === 'thinking') {
Expand Down
25 changes: 21 additions & 4 deletions lpm_frontend/src/app/dashboard/train/training/page.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -48,21 +48,38 @@ interface TrainingDetail {
}

const baseModelOptions = [
{
value: 'Qwen3-0.6B',
label: 'Qwen3-0.6B (8GB+ RAM Recommended)'
},
{
value: 'Qwen3-1.7B',
label: 'Qwen3-1.7B (16GB+ RAM Recommended)'
},
{
value: 'Qwen3-4B',
label: 'Qwen3-4B (32GB+ RAM Recommended)'
},
{
value: 'Qwen3-8B',
label: 'Qwen3-8B (64GB+ RAM Recommended)'
},
// Qwen2.5 models
{
value: 'Qwen2.5-0.5B-Instruct',
label: 'Qwen2.5-0.5B-Instruct (8GB+ RAM Recommended)'
label: 'Qwen2.5-0.5B (8GB+ RAM Recommended)'
},
{
value: 'Qwen2.5-1.5B-Instruct',
label: 'Qwen2.5-1.5B-Instruct (16GB+ RAM Recommended)'
label: 'Qwen2.5-1.5B (16GB+ RAM Recommended)'
},
{
value: 'Qwen2.5-3B-Instruct',
label: 'Qwen2.5-3B-Instruct (32GB+ RAM Recommended)'
label: 'Qwen2.5-3B (32GB+ RAM Recommended)'
},
{
value: 'Qwen2.5-7B-Instruct',
label: 'Qwen2.5-7B-Instruct (64GB+ RAM Recommended)'
label: 'Qwen2.5-7B (64GB+ RAM Recommended)'
}
];

Expand Down
2 changes: 1 addition & 1 deletion lpm_frontend/src/store/useTrainingStore.ts
Original file line number Diff line number Diff line change
Expand Up @@ -151,7 +151,7 @@ export const useTrainingStore = create<ModelState>((set, get) => ({

try {
const res = await getTrainProgress({
model_name: config.model_name || 'Qwen2.5-0.5B-Instruct'
model_name: config.model_name || 'Qwen3-0.6B'
});

if (res.data.code === 0) {
Expand Down
Loading