发帖

立即登录

搜索

Singleshot Prompt Testing

资源库 10 0 5 小时前

S

Singleshot Prompt Testing

通过单次查询在多个供应商和模型上测试并优化提示词，生成成本、Token 使用和性能的详细报告。

该技能数据来源于 ClawHub，详情可查看 ClawHub

源自 ClawHub

V 0.1.0

通过安全检测

1.7千

下载量

8

收藏

Singleshot Prompt Testing & Optimization Skill

Description

Prompt cost testing with single shot

Installation

javascript

Or: cargo install singleshot

When to Use

Testing new prompts before openclaw implementation
Benchmarking prompt variations for token efficiency
Comparing model performance and costs
Validating prompt outputs before production

Core Commands

Always use -d (detail) and -r (report) flags for efficiency analysis:

javascript

Report Analysis Workflow

1. Generate Baseline

javascript

2. Optimize & Compare

javascript

Report Metrics

Reports contain:

javascript

Optimization Strategies

1. Test with cheaper models first:

javascript

Reduce tokens:

Shorten system prompts
Use --max-tokens to limit output
Add "be concise" to system prompt

Test locally (free):

javascript

Example: Full Optimization

javascript

Quick Reference

javascript

Environment Variables

javascript

Best Practices

1. Always use -d for detailed token metrics
2. Always use -r to save reports
3. Always cat reports to analyze metrics
4. Test variations and compare costs
5. Set --max-tokens to control costs
6. Use gpt-4o-mini for testing (cheaper)

Troubleshooting

No metrics: Ensure -d flag is used
No report file: Ensure -r flag is used
High costs: Switch to gpt-4o-mini or Ollama
Connection issues: Run singleshot ping -P <provider>

回复