jianzhiyao
Repos
52
Followers
64
Following
56

Events

Created at 18 hours ago
started
Created at 2 days ago
issue comment
util: add gctuner to avoid gc frequently

why not seperate this component as a repo?

Created at 3 days ago

statistics: fix index isEvicted (#35170)

Signed-off-by: yisaer disxiaofei@163.com

Co-authored-by: Ti Chi Robot ti-community-prow-bot@tidb.io

makefile: remove useless item (#35186)

ref pingcap/tidb#31716

*: support bazel (#33691)

close pingcap/tidb#34083

table: add some injections for testing data-inconsistency defense (#34889)

ref pingcap/tidb#26833

executor: reuse iterator4Slice and Row/RowPtrs slice in HashJoin. (#34878)

ref pingcap/tidb#33877

infosync: fix data race in the mockTiFlashPlacementManager (#35183)

close pingcap/tidb#35182

util: fix data race in ListInDisk (#35199)

close pingcap/tidb#35191

planner: use compareTaskCost to compare costs between different plans in DataSource.findBestTask (#35221)

ref pingcap/tidb#33945

planner: refactor to use the standard function GetXXFactor() to get cost model factors (#35226)

ref pingcap/tidb#33945

BR: fix Unit test TestconfigureRestoreClient (#35214)

close pingcap/tidb#35209

executor: clean test code (#35238)

ref pingcap/tidb#31716

*: delete from mysql.columns_priv when drop a user (#35100)

close pingcap/tidb#35059

*: fix typos in comments and documentations (#35245)

close pingcap/tidb#25052

*: enable more flaky test (#35227)

ref pingcap/tidb#31716

executor: refactor analyze executor (#35201)

  • refactor analyze

Signed-off-by: yisaer disxiaofei@163.com

fix lint

Signed-off-by: yisaer disxiaofei@163.com

fix lint

Signed-off-by: yisaer disxiaofei@163.com

  • address the comment

Signed-off-by: yisaer disxiaofei@163.com

  • address the comment

Signed-off-by: yisaer disxiaofei@163.com

Co-authored-by: Weizhen Wang wangweizhen@pingcap.com Co-authored-by: Ti Chi Robot ti-community-prow-bot@tidb.io

coprocessor: append bucket information in log when errors are returned in coprocess response (#35228)

close pingcap/tidb#35229

statistics/handle: enable flaky and shard test (#35251)

ref pingcap/tidb#35247

metrics: add a config to unregister the unused metrics (#34990)

close pingcap/tidb#34989

tables: remove a useless test (#35125)

ref pingcap/tidb#35103

*: enable race test on util/chunk and update bazel config (#35235)

ref pingcap/tidb#35234

Created at 3 days ago
issue comment
Dynamic Gorotinue Pool

Just like https://github.com/Jeffail/tunny or https://github.com/go-playground/pool ?

Created at 3 days ago
issue comment
Dynamic Gorotinue Pool

Could you describe more detail about this issue? I'm intresting in it.

Created at 3 days ago
started
Created at 1 week ago
there is no where to set mysql server port
Created at 1 month ago

planner: check virtual column for tiflash (#36771)

close pingcap/tiflash#5513, close pingcap/tidb#36773

ddl/schematracker: fix SetDDL will cause data race (#36768)

close pingcap/tidb#36766

*: cleanup sysvar API usage (#36640)

close pingcap/tidb#36639

Merge branch 'master' into opt_getchunk

Created at 1 month ago
issue comment
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

/run-unit-test

Created at 1 month ago

lightning_web: update web package dependency (#36737)

br: add flag to control whether restore priv table on default (#36652)

close pingcap/tidb#36651

session: fix auto commit variable change effect on transaction commit (#36631)

close pingcap/tidb#36581

executor: let plan replayer support cte (#36714)

close pingcap/tidb#36712

executor: refine the error message for TABLE_STORAGE_STATS (#36464)

close pingcap/tidb#36403

*: upgrade staticcheck (#36745)

planner: fix Merge hint for view (#36678)

close pingcap/tidb#36666

lightning: fix check table empty logic (#36747)

close pingcap/tidb#36746

*: enable part revive for all code (#36703)

config, sysvar: add config instance.enable_ddl and sysvar tidb_enable_ddl (#35425)

ref pingcap/tidb#34960

ddl: fix inaccurate row_count for admin show ddl jobs (#36716)

close pingcap/tidb#25968

*: replace defer clean with t.Cleanup (#36722)

close pingcap/tidb#36721

Merge branch 'master' into opt_getchunk

Created at 1 month ago
issue comment
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

Are there any benchmark results for comparison?

benchstat result

name                   old time/op    new time/op    delta
ListInDisk_GetChunk-8    28.9ms ± 2%    11.6ms ± 3%  -59.81%  (p=0.000 n=10+10)

name                   old alloc/op   new alloc/op   delta
ListInDisk_GetChunk-8    71.4MB ± 0%     0.6MB ± 0%  -99.14%  (p=0.000 n=10+8)

name                   old allocs/op  new allocs/op  delta
ListInDisk_GetChunk-8     39.2k ± 0%     16.5k ± 0%  -58.04%  (p=0.000 n=8+10)
Created at 1 month ago

add benchmark for ListInDisk.GetChunk

Merge branch 'opt_getchunk' of github.com:jianzhiyao/tidb into opt_getchunk

Created at 1 month ago
issue comment
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

PTAL @wshwsh12

Created at 1 month ago

util/mock: set sessionvars EnableChunkRPC to true for mock.Context (#36726)

close pingcap/tidb#36725

Merge branch 'master' into opt_getchunk

Created at 1 month ago
Created at 1 month ago
issue comment
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

/run-all-tests

Created at 1 month ago

util/mock: set sessionvars EnableChunkRPC to true for mock.Context (#36726)

close pingcap/tidb#36725

Merge branch 'master' into opt_getchunk

Created at 1 month ago
pull request opened
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

What problem does this PR solve?

Issue Number: close #35636

What is changed and how it works?

rewirte listInDisk.GetChunk

Check List

Tests

  • [x] Unit test
  • [ ] Integration test
  • [ ] Manual test (add detailed scripts or steps below)
  • [ ] No code

Side effects

  • [ ] Performance regression: Consumes more CPU
  • [ ] Performance regression: Consumes more Memory
  • [ ] Breaking backward compatibility

Documentation

  • [ ] Affects user behaviors
  • [ ] Contains syntax changes
  • [ ] Contains variable changes
  • [ ] Contains experimental features
  • [ ] Changes MySQL compatibility

Release note

reduce constructing of chunk in rows
Created at 1 month ago
pull request closed
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

What problem does this PR solve?

Issue Number: close #35636

What is changed and how it works?

rewirte listInDisk.GetChunk

Check List

Tests

  • [x] Unit test
  • [ ] Integration test
  • [ ] Manual test (add detailed scripts or steps below)
  • [ ] No code

Side effects

  • [ ] Performance regression: Consumes more CPU
  • [ ] Performance regression: Consumes more Memory
  • [ ] Breaking backward compatibility

Documentation

  • [ ] Affects user behaviors
  • [ ] Contains syntax changes
  • [ ] Contains variable changes
  • [ ] Contains experimental features
  • [ ] Changes MySQL compatibility

Release note

reduce constructing of chunk in rows
Created at 1 month ago
issue comment
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

/run-test-cla

Created at 1 month ago
issue comment
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

/run-cla

Created at 1 month ago
issue comment
exectuor: reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

/run-all-tests

Created at 1 month ago
create branch
jianzhiyao create branch opt_get_chunk
Created at 1 month ago
delete branch
jianzhiyao delete branch opt_get_chunk
Created at 1 month ago

executor: migrate test-infra to testify for executor_test.go testSplitTable (#33482)

close pingcap/tidb#33437

statistics: fix wrong point range in crossValidationSelectivity (#33357)

ref pingcap/tidb#28030

executor: correct the table range built by 'recover index' (#32960)

close pingcap/tidb#32915

executor: make CI function TestInvalidReadCacheTable more stable (#33093)

close pingcap/tidb#32825

lightning: fix test lightning_checkpoint_chunks (#33503)

close pingcap/tidb#33502

server: refine plan replayer dump file (#33497)

ref pingcap/tidb#26335

*: improve test for import concurrency ddl in the future (#33496)

close pingcap/tidb#33495

br: Ignore ddl jobs with empty query or blacklist type when exec restore (#33384)

close pingcap/tidb#33322

ddl: fix warnings message when alter table nocache and cache again (#33358)

close pingcap/tidb#32692

br: Fix new collaction enable check (#33500)

  • add glue to get global variables

Revert "topsql: enable topsql feature by default (#33195)" (#33493)

close pingcap/tidb#33492

Makefile: add ut to 'make dev' (#33506)

ref pingcap/tidb#30822

util: migrate test-infra to testify for selector_test.go (#33505)

close pingcap/tidb#33460

executor: Enhance task field for explain/explain analyze (#33333)

close pingcap/tidb#33332

store: avoid setting ratelimit action in tracker when disabled (#31110)

ref pingcap/tidb#30353

*: update client-go (#33539)

close pingcap/tidb#33537

planner: restrict plan cache for decimal parameter types (#31769)

close pingcap/tidb#31730

tidb-binlog/node: migrate tests to testify (#33540)

close pingcap/tidb#33462

expression: fix append to result twice when vecEval compress('') (#33523)

close pingcap/tidb#33397

domain: adjust the order of acquireServerID and GlobalInfoSyncerInit to fix global kill test (#33536)

close pingcap/tidb#33538

Created at 1 month ago
pull request opened
reduce listInDisk.GetChunk memory usage(constructing of chunk in rows)

What problem does this PR solve?

Issue Number: close #35636

What is changed and how it works?

rewirte listInDisk.GetChunk

Check List

Tests

  • [x] Unit test
  • [ ] Integration test
  • [ ] Manual test (add detailed scripts or steps below)
  • [ ] No code

Side effects

  • [ ] Performance regression: Consumes more CPU
  • [ ] Performance regression: Consumes more Memory
  • [ ] Breaking backward compatibility

Documentation

  • [ ] Affects user behaviors
  • [ ] Contains syntax changes
  • [ ] Contains variable changes
  • [ ] Contains experimental features
  • [ ] Changes MySQL compatibility

Release note

reduce constructing of chunk in rows
Created at 1 month ago

rewrite Chunk.AppendPartialRow

Created at 1 month ago
create branch
jianzhiyao create branch opt_getchunk
Created at 1 month ago
issue comment
Optimize the memory usage of GetChunk for listInDisk.

/assgin @jianzhiyao

Created at 1 month ago