Skip to content

Commit

Permalink
Added initializations to the generator parameter class
Browse files Browse the repository at this point in the history
  • Loading branch information
Avijit committed Feb 21, 2025
1 parent dacee9f commit 19c5fc8
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions examples/slm_engine/src/cpp/slm_engine.h
Original file line number Diff line number Diff line change
Expand Up @@ -189,6 +189,12 @@ class SLM_ENGINE_EXPORT SLMEngine {
uint32_t TopK;
float TopP;
float Temperature;
explicit GenerationOptions() {
MaxGeneratedTokens = 2048;
Temperature = 0.00000000000001f;
TopK = 50;
TopP = 1.0f;
}
};

/// @brief Asks the GenAI Model for a response
Expand Down

0 comments on commit 19c5fc8

Please sign in to comment.