Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to latest #4

Open
wants to merge 55 commits into
base: master
Choose a base branch
from
Open

Update to latest #4

wants to merge 55 commits into from

Conversation

owen-zora
Copy link
Collaborator

Note: Before submitting this pull request, please review our contributing
guidelines
.

Description

Please describe your pull request.

NOTE: All patches should be made against master, not a maintenance branch like
3.1, 2.5, etc. That is unless the bug is already fixed in master, but not in
that version series.

If it fixes a bug or resolves a feature request,
be sure to link to that issue via (Fixes #4412) for example.

richardhundt and others added 30 commits June 14, 2023 15:32
…st-streaming#510)

* Ensure callback map is rebuilt after reply_to topics are created

* Guard changes to client_only mode

* register reply_to topic with the conductor in the ReplyConsumer

* remove additional logging

* undo refactoring of _tp_index construction

* use MagicMock to make topics iterable

* sort test imports

* run maybe_declare before adding topic to ReplyConsumer

---------

Co-authored-by: Richard Hundt <richard@silicon.ai>
* Fixes AttributeError: 'list' object has no attribute 'difference' in _modify_set

* Make sure sets are properly constructed from list objects during recovery and passed to mode's set collection

---------

Co-authored-by: Richard Hundt <richard@silicon.ai>
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
* initial commit

* isort

* Update type signature

* Add to missing imports

* Remove unused imports

* Remove duplicate docstring

* Add test

* Fix SSL configuration, add test

* Remove client_id and update repr

* linting

* Remove client_id from test

* Add test case to aiokafka transport

* Add documentation on OAuthCredentials

---------

Co-authored-by: Chris Coutinho <chris.coutinho@milence.com>
…eaming#522)

Co-authored-by: Richard Hundt <richard@silicon.ai>
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
…on >= 3.8 (faust-streaming#524)

* Update CI/CD workflows

* disable cython for 3.12 and pypy3.9

* forgot to disable tests for 3.7

* properly disable cython

* syntax is annoying

* we should only test with orjson if we have cython installed

* allow experimentals to fail

* a test should take no longer than ten minutes

* i guess we can't use continue-on-error that way then

* test cibuildwheel

* revert dist.yml changes

* disable testing for 3.12 until properly supported in August or so

* disable scripts/coverage call in scripts/tests because we already do it in a separate job

* remove old tests and disable timeout

* dsiable integ

* try skipping meticulous tests

* disable pypy tests for now

* fix typo

* extend timeout

* switch over setup.cfg to pyproject.toml

* fix linting

* flake8 is impossible to please apparently

* update gh-pages.yml

* fix all yamls

* fix requirements seutp

* cleanup

* should continue on false

* fix continue on error placement

* check linting only

* Update python-package.yml to use experimental

* Update python-package.yml

* Update tests to run meticulous again

* Update python-package.yml to allow 3.12 to fail

* just disable 3.12 for now

* Update python-package.yml to not test pypy until we figure this out

* Update python-package.yml to extend job timeout to 10m

* consolidate dist.yml into python-package.yml

* update pyproject.toml with proper cibuildwheel config

* forgot fetch-depth for wheel builds

* reformat

* skip builds for musllinux_x86_64

* enable check requirement

* revert drastic changes for linting

* pull in new changes from master
* Skip failing tests on PyPy for now

* use move pypy3.9 into main tests

* never mind pypy is experimental then

* skip meticulous tests on pypy

* no cython w/pypy for now

* skip janky tests on pypy

* lint

* rename workflow

* add asyncio_mode = "auto" to pyproject.toml

* undo disabled tests in functional test_streams.py

* enable regular stream testing for unit tests
…t-streaming#531)

Co-authored-by: o.stetsenko <oleksandr.stetsenko@playtech.com>
Bumps [actions/upload-pages-artifact](https://github.com/actions/upload-pages-artifact) from 1 to 2.
- [Release notes](https://github.com/actions/upload-pages-artifact/releases)
- [Commits](actions/upload-pages-artifact@v1...v2)

---
updated-dependencies:
- dependency-name: actions/upload-pages-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump rocksdict to v0.3.13

* Use rocksdict>=0.3.11,<4.0
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v3...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 3 to 4.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](codecov/codecov-action@v3...v4)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [venusian](https://github.com/Pylons/venusian) from 3.0.0 to 3.1.0.
- [Changelog](https://github.com/Pylons/venusian/blob/main/CHANGES.rst)
- [Commits](Pylons/venusian@3.0.0...3.1.0)

---
updated-dependencies:
- dependency-name: venusian
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
* Fix races in conductor with dynamic agents

* Add documentation for `_resubscribe_sleep_lock_seconds`

---------

Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
…etadata definitions into pyproject.toml (faust-streaming#574)

* Consolidate dynamic attributes for setuptools v69.0.0

* commit functioning build

* forgot to lint setup.py lol

* Update authors and maintainers metadata

* remove redundant name metadata definition

* Revert "remove redundant name metadata definition"

This reverts commit 0263fa6.

* bring back long_description in setup.py
* Update setup.py to use setuptools_scm

* Update setup.py
* add fastapi dir and change dep to rocksdict

* commit inital example

* update example

* use lifespan

* reorganize to have an endpoint trigger a producer

* reorganize timer to be above fast api decorator
Bumps [actions/deploy-pages](https://github.com/actions/deploy-pages) from 2 to 3.
- [Release notes](https://github.com/actions/deploy-pages/releases)
- [Commits](actions/deploy-pages@v2...v3)

---
updated-dependencies:
- dependency-name: actions/deploy-pages
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Rename kafka to aiokafka

kafka-python is no longer to be a dependency of aiokafka

Following aio-libs/aiokafka#915

Signed-off-by: Anton Melser <anton.melser@outlook.com>

* Force aiokafka version >=0.9.0

Signed-off-by: Anton Melser <anton.melser@outlook.com>

---------

Signed-off-by: Anton Melser <anton.melser@outlook.com>
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
wbarnha and others added 25 commits December 8, 2023 11:42
…aming#586)

* Replace called_once_with test_objects.py for 3.12 support

* just replace with assert_called_once
* Add official support for Python 3.12

* commit remaining lint changes
… /requirements (faust-streaming#583)

* Update aiokafka requirement in /requirements

Updates the requirements on [aiokafka](https://github.com/aio-libs/aiokafka) to permit the latest version.
- [Release notes](https://github.com/aio-libs/aiokafka/releases)
- [Changelog](https://github.com/aio-libs/aiokafka/blob/master/CHANGES.rst)
- [Commits](aio-libs/aiokafka@v0.8.0...v0.9.0)

---
updated-dependencies:
- dependency-name: aiokafka
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update requirements.txt

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](actions/setup-python@v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2 to 3.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](github/codeql-action@v2...v3)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 3 to 4.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](actions/download-artifact@v3...v4)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3 to 4.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](actions/upload-artifact@v3...v4)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
Bumps [actions/deploy-pages](https://github.com/actions/deploy-pages) from 3 to 4.
- [Release notes](https://github.com/actions/deploy-pages/releases)
- [Commits](actions/deploy-pages@v3...v4)

---
updated-dependencies:
- dependency-name: actions/deploy-pages
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [actions/upload-pages-artifact](https://github.com/actions/upload-pages-artifact) from 2 to 3.
- [Release notes](https://github.com/actions/upload-pages-artifact/releases)
- [Commits](actions/upload-pages-artifact@v2...v3)

---
updated-dependencies:
- dependency-name: actions/upload-pages-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Update agent.py to call loop.create_task rather than asyncio.Task

Credit goes to @samtx for finding this solution for faust-streaming#175 (comment)

* Update agent.py

Co-authored-by: Sam Friedman <samtx@outlook.com>

* Fix linting in agent.py

* Update unit test to verify slurp is awaited

* Update unit test to check awaitable task creation

* Linting and formatting

---------

Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
Co-authored-by: Sam Friedman <sam.friedman@he360.com>
…ing#608)

Co-authored-by: William Barnhart <williambbarnhart@gmail.com>
* Use registry passed to `setup_prometheus_sensors` to generate metric view

* refactor: import `web` once
* Fix imports from updates in mode-streaming

* Require new version of mode-streaming
* robinhood issues 514

* add hopping example

* fix: 'Nonetype' object is not iterable problem

* lint

* remove unused var

* add mock ranges to table tests

* Pull in changes by @thomas-chauvet

* save the popped value as a backup for now

* cleanup and add more tests

* test for ranges when full and empty

* add linting

* remove MagicMock import

---------

Co-authored-by: Don Wong <doncat99@gmail.com>
* mess around this unit tests for aiokafka statuses

* apparently highwater had a bug???

* fix formatting

* wow has this been broken this entire time???

* fix more tests

* lint

* fix yet another test

* fix yet another test

* remove unneeded import

* re-enable another test

* fix linting

* fix another test

* Update aiokafka.py

* revert changes
* Check if pytest<8.1 could fix

* Update test.txt
…ust-streaming#621)

* skip consistency test since it's broken anyway

* skip specific unit tests if pypy

* conditionally disable functional streams tests on pypy

* update lock acquisition for logging in newer python versions

* revert breaking change with timestamp

* fix remaining test

* lint files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.