{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":454708507,"defaultBranch":"main","name":"qbeast-spark","ownerLogin":"Jiaweihu08","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2022-02-02T09:16:44.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/47899566?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1726850101.0","currentOid":""},"activityList":{"items":[{"before":null,"after":"2b1480d90a6f5b5b51a394c0726fcad4a5410a58","ref":"refs/heads/424-sampling-optimization","pushedAt":"2024-09-20T16:35:01.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Add sampling fraction option for optimization, remove analyze from QbeastTable","shortMessageHtmlLink":"Add sampling fraction option for optimization, remove analyze from Qb…"}},{"before":null,"after":"a73bd1f1352c912ded1837f662958b3172744d92","ref":"refs/heads/407-revision-consistency-for-qbeast-table","pushedAt":"2024-09-19T16:08:06.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"WIP","shortMessageHtmlLink":"WIP"}},{"before":"0188840a7a6bedd19d47505fdf9301aa1fc146bf","after":"29cb3ac33a4e7c64d4f6d2dda250f2155b78c90d","ref":"refs/heads/main","pushedAt":"2024-09-19T08:55:07.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue #405: DataWriter refactory (#402)\n\n* Removing the API optimization from DataWriter\r\n\r\n* Adding analyzeAppend and analyzeOptimize to the OTreeManager\r\n\r\n* Reduced the stated to ANNOUNCED and FLOODED","shortMessageHtmlLink":"Issue Qbeast-io#405: DataWriter refactory (Qbeast-io#402)"}},{"before":"d414b8ab0812ef50b9d3ffb895731d73fd47c7bf","after":"0188840a7a6bedd19d47505fdf9301aa1fc146bf","ref":"refs/heads/main","pushedAt":"2024-09-06T09:40:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue 389: Documentation Updates should not trigger CI tests (#396)\n\n* Use paths configuration to ignore the documentation files in CI","shortMessageHtmlLink":"Issue 389: Documentation Updates should not trigger CI tests (Qbeast-…"}},{"before":"527a777115880cc861485630ca7a3c0b4de805df","after":"d414b8ab0812ef50b9d3ffb895731d73fd47c7bf","ref":"refs/heads/main","pushedAt":"2024-09-02T11:52:22.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Update build version to 0.8.0 (#391)","shortMessageHtmlLink":"Update build version to 0.8.0 (Qbeast-io#391)"}},{"before":"dee803bed8f2090d9396a6cf3efb71dd9d773209","after":"527a777115880cc861485630ca7a3c0b4de805df","ref":"refs/heads/main","pushedAt":"2024-08-12T09:56:35.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue 384: Update CODE_OF_CONDUCT.md header (#385)","shortMessageHtmlLink":"Issue 384: Update CODE_OF_CONDUCT.md header (Qbeast-io#385)"}},{"before":"1f228b31f62c68c95a77ec79e810ea005ae33844","after":"146573504d1ea66088ae86ca7e1885392f6094f4","ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-05T17:08:14.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Update documentation for rollupSize","shortMessageHtmlLink":"Update documentation for rollupSize"}},{"before":"cd2b82744fdf3039f10b437ff3f30399acc09979","after":"1f228b31f62c68c95a77ec79e810ea005ae33844","ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-05T14:07:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Test rollupSize for optimize","shortMessageHtmlLink":"Test rollupSize for optimize"}},{"before":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","after":"cd2b82744fdf3039f10b437ff3f30399acc09979","ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-05T13:18:34.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Fix tests","shortMessageHtmlLink":"Fix tests"}},{"before":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","after":null,"ref":"refs/heads/370-rollupSize-option","pushedAt":"2024-08-02T16:27:22.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"}},{"before":null,"after":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-02T16:26:52.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Merge into main","shortMessageHtmlLink":"Merge into main"}},{"before":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","after":null,"ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-02T16:25:57.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"}},{"before":null,"after":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","ref":"refs/heads/370-rollupSize-option","pushedAt":"2024-08-02T16:25:56.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Merge into main","shortMessageHtmlLink":"Merge into main"}},{"before":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","after":null,"ref":"refs/heads/370-rollupSize-option","pushedAt":"2024-08-02T16:25:06.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"}},{"before":null,"after":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","ref":"refs/heads/370-rollupSize-option","pushedAt":"2024-08-02T16:23:52.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Merge into main","shortMessageHtmlLink":"Merge into main"}},{"before":"71272c3cc0c84574e989694ab3caeb6911894fee","after":"d6c5cf77f1b080c479ad25ba6b10d2c2edc5542d","ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-02T16:22:50.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Merge into main","shortMessageHtmlLink":"Merge into main"}},{"before":"4aff09d3e695051cfb757316f57f6b95543313d4","after":"71272c3cc0c84574e989694ab3caeb6911894fee","ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-02T16:16:10.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Add rollupSize test for RollupDataWriter","shortMessageHtmlLink":"Add rollupSize test for RollupDataWriter"}},{"before":"71ee26208ee6c27f8e36c0a0f764f00c0fcf63d7","after":"dee803bed8f2090d9396a6cf3efb71dd9d773209","ref":"refs/heads/main","pushedAt":"2024-08-02T16:11:44.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issues 361,359: Update Release documentation (#376)","shortMessageHtmlLink":"Issues 361,359: Update Release documentation (Qbeast-io#376)"}},{"before":"eb6611801cd3baa0b31fbe68f0b664308f493bfd","after":null,"ref":"refs/heads/370-rollup-cubesize-option","pushedAt":"2024-08-01T14:59:46.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"}},{"before":null,"after":"4aff09d3e695051cfb757316f57f6b95543313d4","ref":"refs/heads/370-rollupCubeSize-option","pushedAt":"2024-08-01T14:50:58.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"WIP, add rollupCubeSize as QbeastOption for writing and optimizing","shortMessageHtmlLink":"WIP, add rollupCubeSize as QbeastOption for writing and optimizing"}},{"before":null,"after":"eb6611801cd3baa0b31fbe68f0b664308f493bfd","ref":"refs/heads/370-rollup-cubesize-option","pushedAt":"2024-08-01T14:46:59.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Test rollupCubeSize through session configuration","shortMessageHtmlLink":"Test rollupCubeSize through session configuration"}},{"before":"3052c6cf0bb4e73d1fbca0c3d05f54083bf84b84","after":null,"ref":"refs/heads/333-reduce-optimization-task-size","pushedAt":"2024-08-01T14:44:37.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"}},{"before":"e305ba372683e1ed2d1389acf2744cbfde629bf3","after":null,"ref":"refs/heads/dataset-api","pushedAt":"2024-08-01T14:44:34.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"}},{"before":"bab1508171cd47255af5dd5698d2d39d3a036084","after":"71ee26208ee6c27f8e36c0a0f764f00c0fcf63d7","ref":"refs/heads/main","pushedAt":"2024-07-30T10:36:27.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue 366: Ensure TBLPROPERTIES consistency between _delta_log, catalog, and Qbeast internals (#367)","shortMessageHtmlLink":"Issue 366: Ensure TBLPROPERTIES consistency between _delta_log, catal…"}},{"before":"910c43dd2a00fb4ac169e08ccb7528afdcaf138b","after":"bab1508171cd47255af5dd5698d2d39d3a036084","ref":"refs/heads/main","pushedAt":"2024-07-26T16:40:30.000Z","pushType":"push","commitsCount":10,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue 365: Fix broken link in README (#362)","shortMessageHtmlLink":"Issue 365: Fix broken link in README (Qbeast-io#362)"}},{"before":"29cdb9e8458e59ff1b1bedc5787f5717ea2bebac","after":"910c43dd2a00fb4ac169e08ccb7528afdcaf138b","ref":"refs/heads/main","pushedAt":"2024-07-24T14:32:18.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue 350: Retrieve Revision information from QbeastTable (#356)","shortMessageHtmlLink":"Issue 350: Retrieve Revision information from QbeastTable (Qbeast-io#356"}},{"before":"af0054e8d8ed04eb7f75aa506ee34b6677d9a788","after":null,"ref":"refs/heads/344-debug-sampling-filtering","pushedAt":"2024-07-16T12:41:21.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"}},{"before":null,"after":"af0054e8d8ed04eb7f75aa506ee34b6677d9a788","ref":"refs/heads/344-debug-sampling-filtering","pushedAt":"2024-07-15T10:34:23.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Log sampling filtering stats only in debug mode.","shortMessageHtmlLink":"Log sampling filtering stats only in debug mode."}},{"before":"a467dd3a5b3d771be489dac41a2c7a7e3386b4ed","after":"29cdb9e8458e59ff1b1bedc5787f5717ea2bebac","ref":"refs/heads/main","pushedAt":"2024-07-12T13:43:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue 343: Reduce metadata memory footprint (#335)\n\nNotable changes:\r\n- Move io.qbeast.core into io.qbeast.spark.core\r\n- Remove blocks from CubeStatus to reduce object size\r\n- Remove file from Block to avoid recursive reference\r\n- loadIndexFiles returns a DataSet[IndexFile]\r\n- Replace .toLocalIterator from IndexStatusBuilder.indexCubeStatuses with collect\r\n- Improve test executions\r\n\r\n---------\r\n\r\nCo-authored-by: jiawei ","shortMessageHtmlLink":"Issue 343: Reduce metadata memory footprint (Qbeast-io#335)"}},{"before":"523c7f195d25ff29ee1c3866baf77b1a9d78003a","after":"a467dd3a5b3d771be489dac41a2c7a7e3386b4ed","ref":"refs/heads/main","pushedAt":"2024-07-11T10:50:47.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"Jiaweihu08","name":"jiawei","path":"/Jiaweihu08","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47899566?s=80&v=4"},"commit":{"message":"Issue 340: ConvertToQbeast should work for table paths containing namespaces (#341)","shortMessageHtmlLink":"Issue 340: ConvertToQbeast should work for table paths containing nam…"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yMFQxNjozNTowMS4wMDAwMDBazwAAAAS8LM5y","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yMFQxNjozNTowMS4wMDAwMDBazwAAAAS8LM5y","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNy0xMVQxMDo1MDo0Ny4wMDAwMDBazwAAAAR8t2Iq"}},"title":"Activity · Jiaweihu08/qbeast-spark"}