Skip to content
This repository has been archived by the owner on Jun 25, 2023. It is now read-only.

Electriclizard trt solution #32

Open
wants to merge 35 commits into
base: main
Choose a base branch
from
Open

Electriclizard trt solution #32

wants to merge 35 commits into from

Commits on May 13, 2023

  1. infrastructure layer

    Artur committed May 13, 2023
    Configuration menu
    Copy the full SHA
    b10375a View commit details
    Browse the repository at this point in the history

  2. service layer

    Artur committed May 13, 2023
    Configuration menu
    Copy the full SHA
    558714a View commit details
    Browse the repository at this point in the history

  3. handlers, configuration and transport app layer

    Artur committed May 13, 2023
    Configuration menu
    Copy the full SHA
    5923b45 View commit details
    Browse the repository at this point in the history

  4. Containerization

    Artur committed May 13, 2023
    Configuration menu
    Copy the full SHA
    a9f6005 View commit details
    Browse the repository at this point in the history

  5. helm chart updates

    Artur committed May 13, 2023
    Configuration menu
    Copy the full SHA
    a9659ca View commit details
    Browse the repository at this point in the history

  6. entrypoint fix

    Artur committed May 13, 2023
    Configuration menu
    Copy the full SHA
    3bae4aa View commit details
    Browse the repository at this point in the history

Commits on May 15, 2023

  1. Merge pull request #1 from electriclizard/dev 

    Dev
    @electriclizard
    electriclizard authored May 15, 2023
    Configuration menu
    Copy the full SHA
    06e3469 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #13 from electriclizard/dev 

    Dev
    @electriclizard
    electriclizard authored May 15, 2023
    Configuration menu
    Copy the full SHA
    8b893f4 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. make models to work with batch

    Artur committed May 16, 2023
    Configuration menu
    Copy the full SHA
    2cd6166 View commit details
    Browse the repository at this point in the history

  2. async queus for model calls

    Artur committed May 16, 2023
    Configuration menu
    Copy the full SHA
    ba96614 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #18 from electriclizard/async 

    Async
    @electriclizard
    electriclizard authored May 16, 2023
    Configuration menu
    Copy the full SHA
    e5167f6 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2023

  1. Merge pull request #2 from electriclizard/async 

    Async
    @electriclizard
    electriclizard authored May 20, 2023
    Configuration menu
    Copy the full SHA
    ae6a534 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #3 from electriclizard/dev 

    Dev
    @electriclizard
    electriclizard authored May 20, 2023
    Configuration menu
    Copy the full SHA
    e13fdea View commit details
    Browse the repository at this point in the history

Commits on May 21, 2023

  1. split model and tokenizer

    Artur committed May 21, 2023
    Configuration menu
    Copy the full SHA
    523b8ff View commit details
    Browse the repository at this point in the history

  2. create one more queue for bacth tokenise task

    Artur committed May 21, 2023
    Configuration menu
    Copy the full SHA
    9f2b047 View commit details
    Browse the repository at this point in the history

  3. split tokenization

    Artur committed May 21, 2023
    Configuration menu
    Copy the full SHA
    614d775 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #4 from electriclizard/splitted-tokenization 

    Splitted tokenization
    @electriclizard
    electriclizard authored May 21, 2023
    Configuration menu
    Copy the full SHA
    9f40de7 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #21 from electriclizard/async 

    Async
    @electriclizard
    electriclizard authored May 21, 2023
    Configuration menu
    Copy the full SHA
    b644a06 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. fix imports

    Artur committed May 30, 2023
    Configuration menu
    Copy the full SHA
    0c9d62d View commit details
    Browse the repository at this point in the history

  2. remove build_models func

    Artur committed May 30, 2023
    Configuration menu
    Copy the full SHA
    d0266a6 View commit details
    Browse the repository at this point in the history

  3. fix Cuda out of memmory error, add a batch size calculating and batch… 

    … processing
    Artur committed May 30, 2023
    Configuration menu
    Copy the full SHA
    71908d7 View commit details
    Browse the repository at this point in the history

  4. fix twice model init and raise batch size

    Artur committed May 30, 2023
    Configuration menu
    Copy the full SHA
    b3d0281 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #26 from electriclizard/splitted-tokenization 

    Splitted tokenization
    @electriclizard
    electriclizard authored May 30, 2023
    Configuration menu
    Copy the full SHA
    d834a64 View commit details
    Browse the repository at this point in the history

  6. fix imports

    Artur committed May 30, 2023
    Configuration menu
    Copy the full SHA
    3d56c7b View commit details
    Browse the repository at this point in the history

  7. fix twice model init

    Artur committed May 30, 2023
    Configuration menu
    Copy the full SHA
    7dd3d48 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Merge pull request #5 from electriclizard/splitted-tokenization 

    Splitted tokenization
    @electriclizard
    electriclizard authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    2a44f61 View commit details
    Browse the repository at this point in the history

  2. onnx runtime for model inference

    Artur committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    a795469 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'electriclizard-solution2' into async

    @electriclizard
    electriclizard authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    3bd9d19 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #29 from electriclizard/async 

    Async onnx runtime
    @electriclizard
    electriclizard authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    1877c36 View commit details
    Browse the repository at this point in the history

  5. onnx graph optimization

    Artur committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    cb32717 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'electriclizard-solution2' into model-optimization

    @electriclizard
    electriclizard authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    64df8c8 View commit details
    Browse the repository at this point in the history

  7. Merge pull request #6 from electriclizard/async 

    Async
    @electriclizard
    electriclizard authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    c4e307b View commit details
    Browse the repository at this point in the history

  8. Merge pull request #7 from electriclizard/model-optimization 

    Model optimization
    @electriclizard
    electriclizard authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    ccde086 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. tensorrt inference

    Artur committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    1377de4 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #31 from electriclizard/trt-provider 

    Trt provider
    @electriclizard
    electriclizard authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    9d01b51 View commit details
    Browse the repository at this point in the history