-
Notifications
You must be signed in to change notification settings - Fork 802
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add explanation for Windows user to how to Create EXE files #419
Comments
Are you able to make a PR proposal with your proposed changes so it can be reviewed and potentially merged in? |
sure... how? |
@jart is this actually more suitable for a wiki instead? If so then could you enable it? This might be more of a freeform doc than a formal instruction. Otherwise, would it make more sense for him to make a new folder /docs/ in the repo? @fabiomatricardi how experience are you to making github contributions? If not very experienced then we could try to accommodate, but do recommend you learn a bit how to use github Pull Request so your contributions can be more easily tracked. |
Hi Brian,
I have never done it before, but I can try.
I only have maintained my own repositories.
Just let me know if I have to go by creating a new folder
like llamafile/docs/windowswiki
or a wiki instead.
In case I have to go for a pull request let me know if I have to do it on a
fork, or you will give me write permissions to the repo
waiting to hear from you
*Matricardi Fabio*
…On Thu, May 23, 2024 at 6:29 PM Brian ***@***.***> wrote:
@jart <https://github.com/jart> is this actually more suitable for a wiki
instead? If so then could you enable it? This might be more of a freeform
doc than a formal instruction.
Otherwise, would it make more sense for him to make a new folder /docs/ in
the repo?
@fabiomatricardi <https://github.com/fabiomatricardi> how experience are
you to making github contributions? If not very experienced then we could
try to accommodate, but do recommend you learn a bit how to use github Pull
Request so your contributions can be more easily tracked.
—
Reply to this email directly, view it on GitHub
<#419 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AFPXVL3O5T4OB35FQLN3O6TZDXAILAVCNFSM6AAAAABHX2FOZGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRWG43DMNZXHA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Discussed in #418
Originally posted by fabiomatricardi May 15, 2024
Ciao,
I tried to ask in the Discord channel but I get no replies... so after 1 week of struggles I understood how to do it.
I would like this to be in the main page of the Repo
How to create .exe files in Windows
In my case i want the executable to run the API server with few more arguments (context length)
Create a
.arg
file as explained in Creating Llamafilesthe file will contain
in the terminal run the following to have the base binary
Then club together with zipalign the llamafile, the GGUF file and the arguments
Finally rename the
.llamafile
into.exe
Run the Qwen model
from the terminal run
This will load the model and start the webserver without opening the browser.
Python API call
Accepting multi line entries in the input: when finished Ctrl+Z and Enter
To exit type quit! and Ctrl+Z and Enter
The text was updated successfully, but these errors were encountered: