big repository
DanielRuf opened this issue · comments
Bug Report
Overview
Currently the repo is about 18MB big.
Expected
The repo should be much smaller for contributors.
Actual
The repo is quite big.
Example
bfg --strip-blobs-bigger-than 1M walt
Using repo : /Users/druf/projects/walt/.git
Scanning packfile for large blobs: 6702
Scanning packfile for large blobs completed in 131 ms.
Found 87 blob ids for large blobs - biggest=6632000 smallest=1068691
Total size (unpacked)=439765329
Found 327 objects to protect
Found 244 tag-pointing refs : refs/tags/rollup-plugin-walt-grammar@0.1.1, refs/tags/walt-buildtools@0.0.2, refs/tags/walt-buildtools@0.0.3, ...
Found 7 commit-pointing refs : HEAD, refs/heads/master, refs/heads/tests/add-nodejs-10, ...
Protected commits
-----------------
These are your protected commits, and so their contents will NOT be altered:
* commit 04b7108d (protected by 'HEAD') - contains 5 dirty files :
- docs/explorer.js (5,3 MB)
- docs/explorer.js.map (5,6 MB)
- ...
WARNING: The dirty content above may be removed from other commits, but as
the *protected* commits still use it, it will STILL exist in your repository.
Details of protected dirty content have been recorded here :
/Users/druf/projects/walt.bfg-report/2018-10-11/14-16-39/protected-dirt/
If you *really* want this content gone, make a manual commit that removes it,
and then run the BFG on a fresh copy of your repo.
Cleaning
--------
Found 391 commits
Cleaning commits: 100% (391/391)
Cleaning commits completed in 826 ms.
Updating 249 Refs
-----------------
Ref Before After
----------------------------------------------------------------
refs/heads/master | 220fa53d | 94978fdc
refs/heads/tests/add-nodejs-10 | 04b7108d | ed18f04b
refs/remotes/origin/master | 220fa53d | 94978fdc
refs/remotes/origin/tests/add-nodejs-10 | 04b7108d | ed18f04b
refs/remotes/origin/wasm-port | 6261e0ef | 17c9e312
refs/tags/rollup-plugin-walt-grammar@0.1.1 | 7ede9dab | ff44fda9
refs/tags/walt-buildtools@0.0.2 | 58fb131c | 5f518fca
refs/tags/walt-buildtools@0.0.3 | ec6d5e88 | 78435efa
refs/tags/walt-buildtools@0.0.4 | f1a526f1 | c108430b
refs/tags/walt-buildtools@0.0.5 | a756f48e | e095d19f
refs/tags/walt-buildtools@0.1.0 | aa729fa0 | 00dfbfa8
refs/tags/walt-cli@0.1.1 | 613120a2 | 574b8dd6
refs/tags/walt-cli@0.1.2 | f66531f1 | ffa14fe8
refs/tags/walt-cli@0.1.3 | b4407249 | 185c9afc
refs/tags/walt-cli@0.1.4 | 4e668780 | 5ad453da
...
Updating references: 100% (249/249)
...Ref update completed in 237 ms.
Commit Tree-Dirt History
------------------------
Earliest Latest
| |
.....................DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
D = dirty commits (file tree fixed)
m = modified commits (commit message or parents changed)
. = clean commits (no changes to file tree)
Before After
-------------------------------------------
First modified commit | 78f4a57d | 8713ed54
Last dirty commit | 220fa53d | 94978fdc
Deleted files
-------------
Filename Git id
-----------------------------------------------------------
example.js.map | b28c0fd5 (1,0 MB)
explorer.js | 6150de05 (4,6 MB), 39fbc6d6 (4,6 MB), ...
explorer.js.map | c526904a (4,9 MB), 9ccf13d5 (5,3 MB), ...
In total, 1103 object ids were changed. Full details are logged here:
/Users/druf/projects/walt.bfg-report/2018-10-11/14-16-39
BFG run is complete! When ready, run: git reflog expire --expire=now --all && git gc --prune=now --aggressive
deleted files
b28c0fd506b7eb75944f0c84671c161d43acfb7e 1068691 example.js.map
6150de059d0e960302178871e4bd4a00ff74418a 4781465 explorer.js
b804118c246420aa1e86500d1dab19a02a0ce796 5549083 explorer.js
f0bb4cebcb7ee58d0e3093d9944cb58f65dd264f 5516371 explorer.js
c7d889fcf4e1fd0421626cb1dac10a3fabf4b1b3 4610581 explorer.js
b7d9e36bf610d3d72c7b0210a137257052ff948d 5298259 explorer.js
a8599527af010f905986c1fde9b86d0ea85a8f5c 5298242 explorer.js
8f02f26d27701bacdbfaacf1b639581a58533749 4600036 explorer.js
7cfaece4722d81027c4a9942a2da61d3859a32fe 4605310 explorer.js
e4163d0cf5675ae771f1fb40f47ef6aa4e58233c 5524130 explorer.js
7b7786973237f2060a9a5bfb7081a67cb9a7c0ca 5546257 explorer.js
ed6c7cfdb0fad68346584839ff8b9945f78908ac 5551820 explorer.js
dda762405ab174d275bf2a63286410f39b76cfea 5517320 explorer.js
ee9b1246b5550583abbe55b8289b9c3bd47304b8 4748940 explorer.js
e370a9534c76a789c62020186ab165be969a014b 4600124 explorer.js
52de5e2597fb56be0764d52eaf461569fac7e4c1 4601329 explorer.js
f7363473d2c106a6d04d66944beda6e6eea02f10 5258928 explorer.js
0d55c3d628125f9d34052f58c7a545f81c9dc6f2 4653725 explorer.js
b579f88128eeda7441f4f9053da1a9c00a77e821 5354211 explorer.js
c53077f898e4133fd06dc5ac83d5575d0789397e 5289083 explorer.js
b92054b79309267b1cddfb29f6666ed087e538fa 4728630 explorer.js
6958f43e76a25119e7a87d67040dbe1cfec3a632 4792112 explorer.js
67dada44ea1fcb262b69236828d2deae37ec2bb1 4771249 explorer.js
369652b4c180ca035c0d9f30110d63321a8fc880 5319559 explorer.js
ff6fd95c6d115b355e8cc94ff7eb47cb055afe78 4601007 explorer.js
7bdae8318339005ec5a41924adcc17d6cde563e4 5353621 explorer.js
aa168558a7eeab6418ac2f0dfdd054af4fb73367 4603274 explorer.js
060e7516fdcf0fd90cc1e14cc9d20d79d2f89046 4779115 explorer.js
5c9428663773fb3f14178cb0035fdb87b49f84b9 4772594 explorer.js
8725f2579bc02e77da49564bb950e598496269cd 4791634 explorer.js
39fbc6d6f6d1b6206f1eec575c2a803c10f0de2e 4781567 explorer.js
ab4a31f2b6f71a69464bf797d7afc7cb9d4f5988 5298370 explorer.js
1d2a739e49b23779cf7ee8fa53df7881893baafd 4649803 explorer.js
5d1af15541341f7553fbe6c2200ca52c27d0a45f 4792123 explorer.js
adb46f81247fa73eb3ac975bfdbd36606d082f6e 4610607 explorer.js
436f8c623dc0b668f6b2d4fb79488946ca068512 5435348 explorer.js
150165002da0acc8dbabfe7c4338de44201f9251 4778086 explorer.js
0ae4b0c8719a0c2acf21e2a5273e03580f73e2ea 4649868 explorer.js
038d933657c14afe19e85ae530c8ca6425a7884b 5525137 explorer.js
1f4b50234d3346ad0578c074bfc2c103f379477d 1251130 explorer.js
9da4ab6d5a699a1dc380b9fb7037a34ac2a46ae3 5551856 explorer.js
90e6ea81065765946d99ccd0e940f0a25220f89d 5297460 explorer.js
3b1a30e10df2ae0c00385d9bb8d05d2812f12585 5318853 explorer.js
17a8ebf21ed951c1e0774ae6636335f7ff4b94dd 6292019 explorer.js
a5872ba7c0fe4d925efaab96e6d7c124dfca7799 4838602 explorer.js.map
97830402c9010d78afe81cf4dcec7fd9763715bd 5148790 explorer.js.map
90cf0b1e2245120ed6a958336e9f8b390526fe1d 4777277 explorer.js.map
fed859dfd7176d7c1f6b99abc9c054093f74cd91 4788582 explorer.js.map
6f095888359ac1b77783c712533764f6cc4283c6 5809813 explorer.js.map
e824361b0f8b5b95037f9ed7307ff65fc76e4320 5839296 explorer.js.map
c28aee1d53a965e7efe90031369f168878899ae2 5504576 explorer.js.map
f7ce3e0da4ff6b9fa4e23e33cac249c56e8fc1b0 4775764 explorer.js.map
f4091ede30af4e9ebc70cd06e9060fe9bcb215d7 5693333 explorer.js.map
114fc4bde0b12391e0bcf4f8ef1bb1096e0dd4b3 5836328 explorer.js.map
9207946d16c899507b619decac6c884b33fe05e6 5839257 explorer.js.map
5264ac4a5423b36c74921325a529c6f13c7e3391 5149877 explorer.js.map
2205f6518284be174f788418a2a179c9cab72753 4842980 explorer.js.map
4cc1e08f5fdf6d43d617bca192a5347215204444 5122764 explorer.js.map
d77e9ed0bed8a9ecf380345a29104a8938fd6002 4781114 explorer.js.map
c526904ab0d6a9412a3ebccb4cb9949f2916858f 5107456 explorer.js.map
587d102e86329aa0299b882d89068a62db2f274d 5833316 explorer.js.map
780bd504db45cce1960b93948958480c5bb45ff3 5533500 explorer.js.map
7a5775f825f51ea1f0f53184cf1378d925149d78 5126867 explorer.js.map
73308fa05b33078704f62de4f3badaa48f30d4c2 4838561 explorer.js.map
b11a4f2c3bced7fb8a52cecee95917ef72b723cb 5149851 explorer.js.map
9ccf13d5c4b60341f7755c9e4e26e8449918bc9f 5542184 explorer.js.map
2b5dd46006f9040edc7250e31efe446dd9c61d42 5094088 explorer.js.map
8084cfebca1d0cf517c989fde8694412af44dc43 5810908 explorer.js.map
786ff8f421b9355ac3152ada19f74b311a64f55e 5120417 explorer.js.map
efcb9b3e2143ad71ff7d3e63874523fccfd52d41 5603991 explorer.js.map
0530f8f360a352f330db790ec9eee356bb5322e8 1516741 explorer.js.map
02100cdfe8fbe823afc343c032b62d6fbca585b9 5542981 explorer.js.map
cd88a9025589550b1fb5af875036784bb2f8fac2 5126686 explorer.js.map
9a8c999f080a3f1fe9b65fabfac4988356979613 5068070 explorer.js.map
bc10b70e501acdd4f557a6c576b4fd941c3a0871 5801502 explorer.js.map
1a8c4db573dbb4f605c2155f97fd6433bcff3836 4775632 explorer.js.map
f93ff7c88e620485b0055236b7d1e81a3c7389d6 5563070 explorer.js.map
270eb1a1470e13eedf4cdb227f20ac55e0dbfd35 5562344 explorer.js.map
6b0fac7f72d2c0fb09efbcda9bcfc7625bfab28f 5543021 explorer.js.map
79113d52af8e3a38766fadbfe8cb94b0da052a25 5110164 explorer.js.map
2fa6d165748d865e4784cd6b3192272fed908d87 4778850 explorer.js.map
03b11a19f96942651ab06d735925ef7ff52873e4 4777080 explorer.js.map
141b04202f33518ae2ea10f3fdf1affee93ff74b 5604612 explorer.js.map
738e93f8cc20b87d6cc849c720f31a3c37e6458a 5802497 explorer.js.map
b5e3670b3548b15e7c5620cbbafd930dfd9dac38 6632000 explorer.js.map
1fcd181e20d8a0f32fcaa30345e5d0fa97eb44c4 4788547 explorer.js.map
0cad91d66551f004c700a7058ba9e245551f918c 5543113 explorer.js.map
Hey, thanks for reporting this.
Took me a bit to respond as I'm not entirely sure what action to take here. The bfg tool is not familiar to me and in general, I did not recognize that the size of the repo was a problem before (but I can see how it might be now).
After reading about BFG here it seems like I should take the steps described to clean the repository. Is that what you are suggesting as a solution?
After reading about BFG here it seems like I should take the steps described to clean the repository. Is that what you are suggesting as a solution?
But in this case you might have to use a new clean branch otherwise there might be conflicts with current clones and PRs as the histories are diverged then.
In our case we use dev / next / master branches and change the default branch later.
You also have a full debug build of React for your webpage. That adds eats up quite a bit of space.
Definitely. That particular problem will be fixed, I'm just holding out for someone to come along and take up that issue.