← 返回列表

GrowingBugRepository: 公开缺陷基准数据集

聚合站 SecWiki技术 入库 2026-11-18T07:22:53

📢📢📢 Our GrowingBugs was selected as the official dataset for the ChinaSoft 2024 Software Defect Repair Competition. Details 👉 https://aprchallenge.github.io/

This is a bug repository that keeps growing, called growingBugs

Notably, each bug in growingBugs is composed of a buggy version, a fixed version, a concise patch (bug-fixing changes only), and one or more triggering test cases.

To free users (especially beginers) of the repository from the complex configuration of the environments, we create and publish a Docker image of the system with latest release version(v7.0). You may download it at https://zenodo.org/records/14286643

By simply loading the image with Docker, you can make the system ready for evaluation where all configurations (e.g., Java versions, paths, and even all data within the repository) should have been well set.

Note that we use "docker export" command to obtain a compressed file. So you nee d to run "docker import" command to use this image.

To date, growingBugs contains 2012 real-world bugs from open-source Java projects.

Project ID Project name SubProject locator Number of bugs Bug IDs
1 AaltoXml aalto-xml 10 1-5,7-11
2 Bcel commons-bcel 6 1-6
3 Ber_tlv ber-tlv 4 1-4
4 Burst burst burst 3 1-3
5 Canvas_api canvas-api 4 1-4
6 Chart jfreechart 26 1-26
7 Cli commons-cli 43 1-5,7-42,50-51
8 Closure closure-compiler 174 1-62,64-92,94-176
9 Codec commons-codec 19 1-19
10 Collections commons-collections 8 25-31,35
11 Commons_suncalc commons-suncalc 2 1-2
12 Compress commons-compress 51 1-48,50,52-53
13 Coveralls_maven _plugin coveralls-maven -plugin 8 1-8
14 Csv commons-csv 17 1-17
15 Dbutils commons-dbutils 2 1-2
16 Deltaspike_api deltaspike-core-api deltaspike /core/api 6 1-6
17 Disklrucache DiskLruCache 6 1-6
18 Docker_java_api docker-java-api 10 1-10
19 Drools_model _compiler drools-model-compiler drools-model/ drools-model-compiler 1 1
20 commons-email 3 3-5
21 Functor commons-functor 2 1-2
22 Geo geo geo 3 1-3
23 Geometry_core geometry-core commons-geometry-core 2 1,3
24 Github_release _plugin github-release-plugin 2 1-2
25 Graph commons-graph 6 1-6
26 Gson gson gson 25 1-25
27 Hivemall_core core core 3 1-3
28 IO commons-io 22 1-3,5-6,8-18, 22,25,27,29-31
29 Imaging commons-imaging 10 1,3-8,10-11,14,16
30 Jackrabbit_ filevault _vault_core jackrabbit-filevault-vault-core vault-core 1 1
31 Jackrabbit_ filevault_vault _validation jackrabbit-filevault-vault-validation vault-validation 4 1-4
32 JacksonCore jackson-core 30 1-26,28-31
33 JacksonDatabind jackson-databind 150 1-85,87-112,121-126, 128-129,131-133,135-156
34 JacksonDataformat Binary_cbor jackson-dataformats -binary-cbor cbor 5 1-5
35 JacksonDataformat Binary_protobuf jackson-dataformats -binary-protobuf protobuf 4 1-4
36 JacksonXml jackson-dataformat-xml 6 1-6
37 James_mime4j _core James-mime4j-core core 9 1-9
38 Lang commons-lang 72 1,3-33,35-65,69,71,73, 76,80-84
39 Math commons-math 35 1-35
40 Mockito mockito 38 1-38
41 Shiro_web shiro-web web 8 1,3,7-12
42 Time joda-time 26 1-20,22-27
43 Deft deft 1 1
44 Dosgi_common dosgi-common common 2 1-2
45 Doubleclick_core openrtb-doubleclick-core doubleclick-core 1 1
46 Doxia_module_apt doxia-module-apt doxia-modules/ doxia-module-apt 2 1-2
47 Drools_traits drools-traits drools-traits 1 1
48 Dropwizard_spring dropwizard-spring 1 1
49 Farm farm 4 1-4
50 Flume_ngcore flume-ng-core flume-ng-core 2 1-2
51 Fluo_api fluo-api modules/api 2 1,3
52 Hbase_common hbase-common hbase-common 1 1
53 Hierarchical_ clustering_java hierarchical- clustering-java 1 1
54 Hilbert_curve hilbert-curve 3 1-3
55 Hive_funnel_udf hive-funnel-udf 1 1
56 Hono_client hono-client client 4 1-4
57 Httpcomponents _core_h2 httpcore5-h2 httpcore5-h2 1 1
58 Httpcomponents _core_httpcore5 httpcore5 httpcore5 3 1-3
59 JXR maven-jxr 1 1
60 Jsoup jsoup 93 1-93
61 JxPath commons-jxpath 22 1-22
62 Math_4j commons-math4j 106 1-106
63 MShade maven-shade-plugin 6 1-4,6-7
64 Tika tika 5 1-2,5-7
65 Validator commons-validator 21 1-2,4,6-9,11, 13-25
66 Pool commons-pool 22 1,5-7,10-14, 16,20-21,24, 26-27,29-35
67 Net commons-net 14 9,10,12, 14-18,20-21, 23-26
68 Numbers_angle commons-numbers-angle commons-numbers -angle 2 1-2
69 MGpg maven-gpg-plugin 1 1
70 Text commons-text 4 1-2,4-5
71 Tika_core tika-core tika-core 23 4,6,9,11, 17,20-25,28-39
72 Tika_app tika-app tika-app 2 1,3
73 Shiro_core shiro-core core 10 37,40,46,52,98, 144,176,181,202-203
74 Jena_core jena-core jena-core 1 2
75 MDeploy maven-deploy-plugin 1 1
76 Jackrabbit_filevault _vault_validation jackrabbit-filevault -vault-validation vault-validation 4 1-4
77 Jackrabbit_oak_core oak-core oak-core 5 1-5
78 Maven_checkstyle _plugin maven-checkstyle -plugin 1 1
79 James_project _core james-project-core core 2 1-2
80 Pdfbox_fontbox pdfbox-fontbox fontbox 7 1-7
81 HttpClient5 httpclient5 httpclient5 7 1-2,4-8
82 jackson_modules _java8_datetime jackson-modules -java8-datetime datetime 5 1-5
83 Pdfbox_pdfbox pdfbox-pdfbox pdfbox 3 1-3
84 Storm_client storm-client storm-client 1 1
85 JacksonDataformats Text_yaml jackson-dataformats -text-yaml yaml 6 1-2,4-7
86 JacksonDataformats Text_properties jackson-dataformats -text-properties properties 2 1-2
87 JacksonDataformat Binary_avro jackson-dataformats -binary-avro avro 2 1-2
88 JavaClassmate java-classmate 2 1-2
89 JacksonModule JsonSchema jackson-module- jsonSchema 1 1
90 JacksonData typeJoda jackson-datatype-joda 2 2-3
91 JacksonDatatype Jsr310 jackson-datatype-jsr310 4 1-4
92 JacksonDataformat Binary_smile jackson-dataformats -binary-smile smile 3 1-3
93 JacksonModule Afterburner jackson-module-afterburner 3 1-3
94 Woodstox woodstox 7 1-7
95 MetaModel_core MetaModel-core core 9 1-9
96 MetaModel_csv MetaModel-csv csv 1 1
97 MetaModel_excel MetaModel-excel excel 1 1
98 MetaModel_jdbc MetaModel-jdbc jdbc 3 1-3
99 MetaModel_pojo MetaModel-pojo pojo 1 1
100 MetaModel_ salesforce MetaModel-salesforce salesforce 1 1
101 Wink_common wink-common wink-common 4 1-4
102 Xbean_naming xbean-naming xbean-naming 1 1
103 James_project_ server_container _core james-project-server- container-core server/container/core 1 1
104 Johnzon_core johnzon-core johnzon-core 11 1-2,4-12
105 Nifi_mock nifi-mock nifi-mock 2 1-2
106 Rat_core apache-rat-core apache-rat-core 1 1
107 Rat_plugin apache-rat-plugin apache-rat-plugin 1 1
108 Tez_common tez-common tez-common 1 1
109 Tinkerpop_gremlin _core gremlin-core gremlin-core 1 1
110 Webbeans_web webbeans-web webbeans-web 1 1
111 Johnzon_jsonb johnzon-jsonb johnzon-jsonb 6 1-6
112 Johnzon_jaxrs johnzon-jaxrs johnzon-jaxrs 1 1
113 Incubator_tamaya _api incubator-retired -tamaya-api code/api 2 1-2
114 James_project_ mailet_standard james-project- mailet-standard mailet/standard 1 1
115 Johnzon_ jsonschema johnzon-jsonschema johnzon-jsonschema 2 1-2
116 Johnzon_ mapper johnzon-mapper johnzon-mapper 6 1-6
117 Karaf_main karaf-main main 1 1
118 Appformer_uberfire _commons_editor _backend uberfire-commons-editor-backend uberfire-extensions /uberfire-commons-editor/ uberfire-commons-editor-backend 1 1
119 Kie_pmml_ commons kie-pmml-commons kie-pmml-trusty/ kie-pmml-commons 3 1-3
120 Kie_memory_ compiler kie-memory-compiler kie-memory-compiler 1 1
121 Jbpm_human _task_workitems jbpm-human-task-workitems jbpm-human-task/ jbpm-human-task-workitems 1 1
122 Appformer_uberfire_ security_management _client uberfire-security-management-client uberfire-extensions /uberfire-security /uberfire-security-management /uberfire-security -management-client 1 1
123 Appformer_uberfire _workbench_client uberfire-workbench-client uberfire-workbench/ uberfire-workbench-client 3 1-3
124 Jandex jandex 6 1-6
125 Kogito_editors _java_kie_wb _common_stunner _widgets kie-wb-common- stunner-widgets kie-wb-common-stunner/ kie-wb-common-stunner-client/ kie-wb-common-stunner-widgets 1 1
126 Ognl commons-ognl 1 1
127 Qpid_client qpid-jms-client qpid-jms-client 8 1-8
128 Switchyard_admin switchyard-admin admin 1 1
129 Weld_se_core weld-se-core environments/se/core 1 1
130 Jboss_modules jboss-modules 5 1,3-6
131 Jboss_threads jboss-threads 1 1
132 Minaftp_api ftpserver-api ftplet-api 1 1
133 Sling_ validation sling-org-apache-sling-validation-core 1 1
134 Switchyard_ config switchyard-config config 1 1
135 Switchyard_ validate switchyard-validate validate 1 1
136 Wildfly_naming _client wildfly-naming-client 2 1-2
137 Knox_assertion _common gateway-provider- identity-assertion -common gateway-provider- identity-assertion -common 1 1
138 Oozie_client oozie-client client 2 1-2
139 Qpidjms_client qpidjms-client client 3 1-3
140 Rdf4j_query rdf4j-query core/query 1 1
141 Rdf4j_rio_api rdf4j-rio-api core/rio/api 2 1-2
142 Rdf4j_rio_jsonld rdf4j-rio-jsonld core/rio/jsonld 2 1-2
143 Rdf4j_rio_rdfjson rdf4j-rio-rdfjson core/rio/rdfjson 2 1-2
144 Rdf4j_rio_rdfxml rdf4j-rio-rdfxml core/rio/rdfxml 1 1
145 Rdf4j_rio_turtle rdf4j-rio-turtle core/rio/turtle 8 1-4,6,8-10
146 Sentry_ccommon sentry-core-common sentry-core/sentry-core-common 2 1-2
147 Sling_apiregions sling-apiregions 3 1-3
148 Sling_cpconverter sling-cpconverter 3 1-3
149 Tiles_api tiles-api tiles-api 2 1-2
150 Tiles_core tiles-core tiles-core 3 1-3
151 Twill_dcore twill-discovery-core twill-discovery-core 1 1
152 Maven2_artifact maven-artifact maven-artifact 2 1-2
153 Maven2_project maven-project maven-project 2 1-2
154 Wicket_request wicket-request wicket-request 6 1-6
155 Cayenne_xmpp cayenne-xmpp cayenne-xmpp 1 1
156 Wicket_util wicket-util wicket-util 4 1-4
157 Wicket_spring wicket-spring wicket-spring 1 1
158 Cayenne_jgroups cayenne-jgroups cayenne-jgroups 1 1
159 Cayenne_jms cayenne-jms cayenne-jms 1 1
160 Struts1_core struts1-core core 2 1-2
161 Wicket_cdi wicket-cdi wicket-cdi 1 1
162 Wicket_core wicket-core wicket-core 18 1-18
163 Mshared_archiver maven-archiver maven-archiver 1 1
164 Shindig_common shindig-common java/common 1 1
165 Xbean_reflect xbean-reflect xbean-reflect 2 1-2
166 Mrunit mrunit 6 1-6
167 Rave_core rave-core rave-components /rave-core 2 1-2
168 Rave_commons rave-commons rave-components /rave-commons 1 1
169 Rave_web rave-web rave-components/rave-web 1 1
170 Jmh_core jmh-core jmh-core 1 1
171 Sdk_core sdk-core 3 1-3
172 Cargo_container cargo-container core/api/ container 4 1-4
173 Oak_commons oak-commons oak-commons 1 1
174 Streamex streamex 7 1-7
175 Javapoet javapoet 17 1-17
176 RTree rtree 12 1-12
177 Spoon spoon 17 1-17
178 Slack_java _webhook slack-java-webhook 1 1
179 Zip4j zip4j 52 1-52
180 Incubator_ retired_pirk incubator-retired-pirk 1 1
181 Sparsebitset SparseBitSet 2 1-2
182 Assertj_assert ions_generator assertj-assertions -generator 7 1-7
183 Config_magic config-magic 2 2
184 Jcodemodel jcodemodel 7 1-7
185 Jdbm3 JDBM3 6 1-6
186 Mybatis_pagehelper Mybatis-PageHelper 4 1-4
187 N5 n5 2 1-2
188 Stash_jenkins_ postreceive _webhook stash-jenkins -postreceive-webhook 1 1
189 Suffixtree suffixtree 1 1
190 Template_ benchmark template-benchmark 1 1
191 Vectorz vectorz 6 1-6
192 Cli_parser cli-parser 1 1
193 Gatling_report gatling-report 3 1-3
194 Semux_core semux-core 1 3
195 Solarpositioning solarpositioning 3 1-3
196 Sparkey_java sparkey-java 3 1-3
197 Shazamcrest shazamcrest 2 1-2
198 Restfixture RestFixture 4 1-4
199 Chronicle_network Chronicle-Network 4 1-4
200 Gocd_slack_build _notifier gocd-slack- build-notifier 3 1-3
201 Confluence_http _authenticator confluence_http _authenticator 1 1
202 Tempus_fugit tempus-fugit 1 1
203 Kafka_graphite kafka-graphite 1 1
204 Simple_excel simple-excel 1 1
205 Trident_ml trident-ml 1 1
206 Tascalate_ concurrent tascalate-concurrent 2 1-2
207 Jcabi_github jcabi-github 81 1-42,44-82
208 Podam podam 1 1
209 Sansorm SansOrm 7 1-7
210 Transmittable_ thread_local transmittable -thread-local 4 1-4
211 Jchronic jchronic 1 1
212 Netconf_java netconf-java 1 1
213 Xades4j xades4j 4 1-4
214 Spatial4j spatial4j 4 1-4
215 Iciql iciql 2 1-2
216 Metrics_opentsdb metrics-opentsdb 2 1-2
217 Spring_context _support spring-context -support 1 2
218 Jmimemagic jmimemagic 1 1
219 Markedj markedj 17 1-17
220 Sonartsplugin SonarTsPlugin 10 1-10
221 Aws_maven aws-maven 1 1
222 Snomed_owl _toolkit snomed-owl -toolkit 2 1-2
223 Weak_lock_free weak-lock-free 1 1
224 Proj4J proj4j 9 1-9
225 Markedj markedj 2 1-2
226 Rocketmq_mqtt_ds rocketmq-mqtt-ds mqtt-ds 1 1
227 Retrofit retrofit retrofit 3 1-3
228 Jnagmp jnagmp jnagmp 1 1
229 Rocketmq_ mqtt_cs rocketmq-mqtt-cs mqtt-cs 1 1
230 Dagger_core dagger-core core 20 1-20
231 Google_java _format_core google-java -format-core core 1 1
232 Jimfs jimfs jimfs 2 1-2
233 Open_location _code_java open-location -code-java java 4 1-4
234 Gwtmockito gwtmockito gwtmockito 3 1-3
235 Render_app render-app render-app 5 1-5
236 Tape tape tape 13 1-13
237 Jcabi_http jcabi-http 16 1-16
238 Jcabi_aether jcabi-aether 1 1
239 Jcabi_w3c jcabi-w3c 1 1
240 Jcabi_email jcabi-email 4 1-4
241 Jcabi_log jcabi-log 9 1-9
242 Jcabi_matchers jcabi-matchers 2 1-2
243 Jfreechart_fse jfreechart-fse 2 1-2
244 Jfreesvg jfreesvg 1 1
245 Leshan_core leshan-core leshan-core 10 1-10
246 Rdf_jena commons-rdf-jena commons-rdf-jena 1 1
247 Jackson_ annotations jackson-annotations 1 1
248 Jackson_datatype _hibernate4 jackson-datatype -hibernate4 hibernate4 1 1
249 Rtree2 rtree2 6 1-6
250 Subethasmtp subethasmtp 1 1
251 Fileupload commons-fileupload 2 1-2
252 Beanutils commons-beanutils 27 1-18,20-21,23-29
253 Hugegraph_common hugegraph-common hugegraph-common 5 1-5
254 Dbcp commons-dbcp 18 1-7,9-19
255 Rng_sampling rng-sampling rng-sampling 2 1-2
256 Scxml scxml 30 1-12,14,16,18,20,22,25,27,31,33-42
257 Mrunit commons-mrunit 4 1-4

Note that only Ubuntu 18 and later are supported.

  1. Clone GrowingBugs:
    - git clone https://github.com/liuhuigmail/GrowingBugRepository.git
  2. Initialize GrowingBugs: Download the project repositories and external libraries that are not included in the git repository for size purposes and to avoid redundancies. We provide a mechanism to download them automatically as follows:
    - cd GrowingBugRepository
    - sudo cpanm --installdeps .
    - ./init.sh
    - ./repos.sh
  3. Add GrowingBugs's executables to your PATH:
    - export PATH=$PATH:"path2growingbugs"/framework/bin

  4. Checkout a buggy source code version (If the project doesn't hava subproject, -s parameter can be ignored):
    - defects4j checkout -p project_id -v version_id -w work_dir -s subproject_locator
    Example:
    - defects4j checkout -p Shiro_core -v 37b -w /tmp/Shiro_core_37_buggy -s core
    - defects4j checkout -p Dbutils -v 1b -w /tmp/dbutils_1_buggy
    Notably, GrowingBugs supports sub-projects that are not suported by Defects4J. To this end, yor should specify the sub-project with -s parameter in the checkout command. The preceding example common leverages -s core to check out sub-proejct core from the enclosing project Shiro_core. For the compile and test commands, you should also switch to the sub-project's folder to compile and test the sub-project.

  5. Change to the working directory, compile sources and tests, and run tests:
    - cd work_dir/subproject_locator
    - defects4j compile
    - defects4j test
    Example1:
    - cd /tmp/Shiro_core_37_buggy/core
    - defects4j compile
    - defects4j test
    Example2:
    - cd /tmp/dbutils_1_buggy
    - defects4j compile
    - defects4j test

Currently, we resuse all APIs of Defects4J (more details at https://github.com/rjust/defects4j), and thus all applications relying on Defects4J could be transferred smoothly to GrowingBugs.

Because the bug repository keeps growing, let us known if you need a stable version for your study (e.g., evalutions for a research paper), and we will release a specific version where the bugs and patches are fixed (to faciliate the replication of your study).

Notably, this bug repository is based on the well-known Defects4J https://github.com/rjust/defects4j. We reuse its source code as well as the bugs in Defects4J. The key difference is that growingBugs levearages BugBuilder[1] to exclude bug-irrelevarange changes from bug-fixing commmits automatically whereas Defects4J requests human experts to accomplish the same task. Consequently, growingBugs can keep growing automatically even without human intervention.

If you are exploiting our dataset, please kindly cite the following paper:

[1] Yanjie Jiang, Hui Liu*, Nan Niu, Lu Zhang, Yamin Hu. Extracting Concise Bug-Fixing Patches from Human-Written Patches in Version Control Systems. The 43rd International Conference on Software Engineering (ICSE), pp. 686-698, May, 2021

[2]Yanjie Jiang, Hui Liu*, Xiaoqing Luo, Zhihao Zhu, Xiaye Chi, Nan Niu, Yuxia Zhang, Yamin Hu, Pan Bian, and Lu Zhang. " BugBuilder: An Automated Approach to Building Bug Repository," in IEEE Transactions on Software Engineering, Online 2022, doi: 10.1109/TSE.2022.3177713

[3]Yanjie Jiang, Hui Liu*,Yuxia Zhang, Weixing Ji, Hao Zhong, and Lu Zhang. "Do Bugs Lead to Unnaturalness of Source Code?" In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2022). Association for Computing Machinery, New York, NY, USA, 1085–1096. https://doi.org/10.1145/3540250.3549149

@INPROCEEDINGS {GrowingBugsICSE21, author = {Yanjie Jiang and Hui Liu and Nan Niu and Lu Zhang and Yamin Hu}, booktitle = {IEEE/ACM 43rd International Conference on Software Engineering (ICSE 2021)}, title = {Extracting Concise Bug-Fixing Patches from Human-Written Patches in Version Control Systems}, year = {2021}, pages = {686-698}, doi = {10.1109/ICSE43902.2021.00069}, url = {https://doi.ieeecomputersociety.org/10.1109/ICSE43902.2021.00069}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, month = {may} }

@ARTICLE{GrowingBugsTSE2022, author={Jiang, Yanjie and Liu, Hui and Luo, Xiaoqing and Zhu, Zhihao and Chi, Xiaye and Niu, Nan and Zhang, Yuxia and Hu, Yamin and Bian, Pan and Zhang, Lu}, journal={IEEE Transactions on Software Engineering}, title={BugBuilder: An Automated Approach to Building Bug Repository}, year={2022}, volume={}, number={}, pages={1-22}, doi={10.1109/TSE.2022.3177713}}

@inproceedings{NaturalnessOfBugsFSE2022, author = {Jiang, Yanjie and Liu, Hui and Zhang, Yuxia and Ji, Weixing and Zhong, Hao and Zhang, Lu}, title = {Do Bugs Lead to Unnaturalness of Source Code?}, year = {2022}, isbn = {9781450394130}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3540250.3549149}, doi = {10.1145/3540250.3549149}, booktitle = {Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering}, pages = {1085–1096}, numpages = {12}, keywords = {Naturalness, Source Code, Bug Fixing, Bugs, Code Entropy}, location = {Singapore, Singapore}, series = {ESEC/FSE 2022} }

原文链接:https://github.com/liuhuigmail/GrowingBugRepository