SageSELab / AndroR2

This repository holds the data and code for the AndroR2 dataset of manually-reproduced bug reports for Android apps

AndroR2: A Dataset of Manually-Reproduced Bug Reports for Android apps

• Reproducible bug reports are located in the reports folder.
• Reproduction metadata is located in the metadata folder and encoded in JSON files.
• The relevant APKs are in the apks folder.
• The reproduction scripts are located in the scripts folder here and the instructions for running the scripts are also located in the scripts folder here.
• The code utilized for data collection can be found in the code folder.
• A ZIP file of JSON containing the 82,455 issues can be found in database.

Reproducible Bug Reports

• ID = identifier of the bug report in this dataset
• GitHub Issue = link to the bug report on GitHub
• Commit ID = commit ID identifying the app version used to reproduce the bug report
• Android OS Version = Android version used to reproduce the bug report
• Failure Type = type of failure associated with the bug report. crash identifies a crash in the app, output represents an error in the output of the app, gui identifies an error in the properties of the GUI of the app
• S2Rs = number of textual S2Rs in the bug report
• GUI Actions = number of GUI actions necessary to reproduce the failure described in the bug report
• Setup GUI Actions = setup GUI actions (SGAs). Number of GUI actions that need to be performed before the first GUI action mentioned in the S2Rs can be performed
• RS GUI actions = report-specific GUI actions (RSGAs). Number of GUI actions that are necessary to reproduce the bug reports starting from the first the GUI action associated with the first S2R
• RS Missing GUI Actions = report-specific and missing GUI actions. Number of GUI actions that are not mentioned by the S2Rs but are necessary to reproduce the failure described in the bug report
• Multiple GUI Action S2Rs = multiple-GUI-action S2Rs (MGAS2Rs). S2Rs that lead to execution of multiple GUI actions.
• GUI Actions in MGAS2Rs = number of GUI actions in multiple-GUI-action S2Rs.
• SGAs in Android OS = Whether a setup GUI action has been involved that requires the Android OS
• SGAs Outside App = Whether a setup GUI action has been performed outside of the app and not in Android OS
• RSGAs in the Android OS = Whether a report-specific GUI action has been involved that requires the Android OS
• RSGAs Outside App = Whether a report-specific GUI action has been performed outside of the app and not in Android OS

ID	Github Issue	Commit ID	Android OS Version	Failure Type	S2Rs	GUI Actions	Setup GUI Actions	RS GUI Actions	RS Missing GUI Actions	Multiple GUI Action S2Rs	GUI Actions in MGAS2Rs	SGAs in Android OS	SGAs Outside App	RSGAs in Android OS	RSGAs Outside App
2	Link	d365188d7c7b9d9eb0021e73e0c6dc37aba79a3f	6.1	crash	6	6	0	6	0	0	0	1	0	0	0
7	Link	2adbfce4039a6501bf2512a765ced223c53da315	8.1	crash	2	5	0	5	0	0	0	0	0	0	0
8	Link	7ef227ada3454529c7def79e41f48f6fa7b7463c	6	crash	3	11	6	5	0	1	4	0	0	0	0
10	Link	003408bb61478c32f3119f7cb5e301db44caa199	6	output	5	10	1	9	3	2	2	0	0	0	0
11	Link	d3ab226c2d0e67b597a4d2cde1d652ceff6c1f52	6.1	crash	4	2	0	2	0	0	0	0	0	0	0
18	Link	6f0dcf6070cd132eba51824ebbfa743eb22b0568	8	crash	2	19	15	4	0	1	3	0	0	0	0
19	Link	8a2cb5df10f4aea90c79a2d111c989ae1830544a	7.1.1	gui	3	5	1	4	0	1	2	1	0	0	0
21	Link	394ccfc0c04223a263411e8af4487458e848d319	8.0.0	gui	3	8	1	7	0	1	5	0	0	0	0
22	Link	394ccfc0c04223a263411e8af4487458e848d319	7.1.1	gui	3	11	7	4	0	1	2	0	0	0	0
23	Link	de7d145b82ae5e06991ba1b9a598d8ec6647f1f9	7	crash	4	4	3	1	0	0	0	0	0	0	0
35	Link	e1c5681e628efd895d6f513047d94b618c00a144	8	output	4	21	12	9	0	2	7	1	0	0	0
43	Link	5cc16b32eb5e65e6f8381d7ca097a3a8aabea57e	7.1.2	crash	2	31	28	3	1	1	0	1	0	0	0
44	Link	8d09f7ab504d520f9c456c2a12a5aa0067be0d90	9.0.0	output	3	18	7	11	5	2	5	0	0	0	0
45	Link	68d074acc7e3e8acda7709b88f007820e81923cd	8.1.0	output	7	27	15	12	1	0	0	1	1	0	0
50	Link	d61672a19c538250f305352d35dace108c3594cd	9	crash	1	1	0	1	0	0	0	0	0	0	0
51	Link	2542c42b677b77620d170bb89bc68da767b4d65e	7	output	3	10	4	6	1	2	4	1	0	1	0
53	Link	73c73f21ffecbdec2d35bae8e0472980572af8e5	3	output	6	15	7	8	3	1	3	1	0	1	0
54	Link	1a5478a490eb569551f4e30f2d668e28a9f95559	8	output	6	10	4	6	1	1	2	1	0	1	0
55	Link	395e94bf62312dfd3df66fdbad75412aacf733a2	10	gui	3	26	6	20	0	3	20	1	0	0	0
56	Link	68912f28ed6408d65198fecbb80e16e75d1c3532	10	output	4	18	6	12	0	3	12	1	0	0	0
62	Link	e5ec9ddbf335cffb226f4d82fac4f48b6c756667	8	output	5	16	2	14	4	4	10	1	0	1	0
71	Link	3102b83a3c6208f7ba36a235d71254f1c8c8a9ff	10	gui	5	6	1	5	0	0	0	0	1	1	0
73	Link	d26d2126072654ba95f31f2bb638479bc2f199c4	8	gui	3	9	6	3	0	1	2	0	0	0	0
76	Link	bea5ce3bce36cccf5a34d833ac6d8fc2e237984d	Fire OS 5.2.6.9	gui	3	6	6	0	6	0	0	0	0	0	0
84	Link	95496eb1200e892600b60d5048248e893b339af3	4.4.4 API 19	output	8	8	0	8	0	0	0	0	0	0	0
91	Link	b5433c0e9a7e86f234915d409abe2d46c62363bb	7	output	2	3	1	2	1	0	0	1	0	0	0
92	Link	cffde47fb60e1f030e0ba1665813af91ca057976	6.0.1	output	4	5	1	4	1	1	1	0	0	0	0
96	Link	3715e4fed61d0f5d28ff9fc91919f3381c98e551	10	output	4	13	10	3	0	1	2	0	0	0	0
97	Link	4ef81ae0d68bd3f062f4c763f9653300bc3ef2f1	6.0.1	crash	7	10	6	4	0	2	4	0	0	0	0
101	Link	4ef81ae0d68bd3f062f4c763f9653300bc3ef2f1	6.0.1	gui	4	8	6	2	0	0	0	0	0	1	0
106	Link	b18e0559b9fdd8eabd8504eaa4927708e7b80216	8	output	2	5	2	3	1	1	2	1	0	0	0
107	Link	deac585a029850463ea92a5c5291c5f45d0b6518	9	gui	3	6	2	4	0	1	4	1	0	0	0
110	Link	9971a70093f6b0c2c325ae5afda91c30fe96e54f	11	gui	3	4	2	2	0	1	2	1	1	0	0
117	Link	fb45dce67c0756eb710a776ea940e243e21b94e6	8.1	gui	2	10	4	6	0	1	5	0	0	0	0
121	Link	ec7a257fba6e0ba29a793eeaebb1179aaf4f343f	9	gui	12	15	6	9	0	0	0	0	0	0	0
122	Link	bf39d2825b5ff831ee515570e06bfd1afc95d13d	8	gui	3	16	8	8	5	3	8	0	0	0	0
123	Link	bf39d2825b5ff831ee515570e06bfd1afc95d13d	9	output	2	20	8	12	6	1	4	0	0	1	0
125	Link	118fd15d4ca830ce1953f079cc20b25020856546	8	gui	4	16	8	8	5	2	7	0	0	0	0
128	Link	30b0b5747e728b9515ac36ca9c471c824854aaf1	6	output	2	14	10	4	4	0	0	0	0	0	0
129	Link	b8b9834f06cf28686be5874923607f677b094df6	9	crash	3	19	9	10	0	2	9	0	0	0	0
130	Link	7c34318c407c4677d3afdf27bdeb998244759720	8	gui	2	2	2	0	0	0	0	0	0	0	0
132	Link	d7b956e5ac8d4ea3b590a929a8176975afd86422	7	output	4	22	15	7	1	1	4	1	1	0	1
135	Link	83d1d1ee402dbd680192691a777aa3e4b10e5c55	8.1.0	output	4	12	8	4	0	0	0	0	0	0	0
137	Link	9709dfaeee4cd9e2d6a51a2d44de67682b3811d6	8	crash	4	4	0	4	0	0	0	0	0	0	0
139	Link	e8f99a323b82a0323eb3ffcff8907429797522ab	5	gui	2	5	0	5	0	2	4	0	0	0	0
142	Link	4e4a72cafdba463b571610a0ccd401153594dd71	6.0.1	output	3	10	4	6	0	2	5	0	0	0	0
144	Link	71deb2dfd033d940aa7d91794322618ba39abf4d	sdk v27	gui	3	17	13	4	0	0	0	0	1	0	0
145	Link	3fbf6dfa3ae8f536c3b6d6537d5cb1133634d59c	6.0.1	gui	3	11	3	8	2	2	6	0	0	0	1
151	Link	cc55a6dacb02cde5528fbab400de716ca3b10c11	7	gui	3	15	10	5	0	0	0	0	0	0	1
152	Link	10c206270a567052acd13f48e484332bb02e3a05	7	output	2	12	4	8	0	1	4	0	0	0	0
155	Link	6e54497492cf0b8329f423bae5e1879b2ede4fd9	9	output	3	8	4	4	0	1	4	0	0	0	0
157	Link	679229d7c8c5e9a4f9e1425ddf521d7d83ae08a5	10	output	2	8	2	6	0	2	6	1	0	0	0
158	Link	5c7ef543d2ac9233ba6818e43b1d1a097f7332a8	11	gui	3	10	7	3	1	1	2	1	0	0	0
159	Link	2948dfbb88bf535a6099245dfd5bc1432f9c8914	11	crash	3	37	2	35	0	3	35	1	0	0	0
160	Link	abd1db25de96a2f11fb08291e56aa6728bd7de61	11	gui	3	14	8	6	0	1	4	1	0	0	0
162	Link	6e392f62b78689f7a05bdb728ce81955dcebb8e1	6	crash	4	6	1	5	0	1	5	0	0	0	0
164	Link	6ff1b67a7f1f5b270eb7c8c7e0b60c9ba47f2d33	7	gui	3	7	1	6	0	1	6	0	0	0	0
165	Link	a903bd6f81e929bdd486b12e24afe851d06b7dcf	10	output	3	28	23	5	0	2	4	0	0	1	1
168	Link	31240dd2fc63d91aef6fd71a4e09b50d1d169599	10	crash	3	3	2	1	0	0	0	1	0	0	0
174	Link	892b1ee0cfdbdd747a37e413e205258f46970972	10	crash	3	6	1	5	1	2	4	0	0	1	1
178	Link	1d950d187fae89396ce6b1d0f78f6e44dd095440	4.4.2	crash	1	1	1	0	0	0	0	0	0	0	0
186	Link	dbed34ce37ffda535833cccd81b4d576961038b1	8	crash	4	2	0	2	0	0	0	0	0	0	0
188	Link	204365adfb400b8ef098c4d9fa4f6852b9b4eb98	8	gui	4	6	0	6	2	2	4	0	0	0	0
191	Link	6e925f1e60796c2f1623a1514e9d9192ab3bfd1e	8	output	2	2	0	2	0	0	0	0	0	0	0
192	Link	7214fc661e79f0a9cb18344a2be14d169f212889	8	gui	3	12	8	4	0	1	2	1	0	1	0
193	Link	a6cd4f2a11b78135e4d9884fc6b18c1d96a8ca94	8	gui	6	5	3	5	0	0	0	1	0	0	0
198	Link	5a84332a1679f179777404ccd541e00541512efb	8	crash	4	12	0	12	0	2	9	1	0	0	0
199	Link	64d685e530715186fdb4cfecfce01ee79328f166	7	output	4	15	6	4	2	1	1	0	0	0	1
200	Link	10337dac94ee9631ec560718a8d85c033681b23d	8	output	3	10	6	3	0	0	0	1	0	0	0
201	Link	1ae5ed05e9b4c5927db5a4daa9307695beb8c286	7	gui	3	12	6	3	2	1	1	0	0	0	0
205	Link	a8646bb730cced3bf552297d5560ea2c12d3b77e	8	output	4	9	1	8	4	3	7	1	0	1	0
206	Link	d1c31033366ae7044e4b115b9ac021060660ef18	8	output	2	11	9	3	1	1	2	1	0	1	0
208	Link	d1c31033366ae7044e4b115b9ac021060660ef18	8	crash	2	12	9	4	2	0	0	1	0	1	0
209	Link	52f72970eada423f10ed11359f628c5755545b24	8	gui	5	12	7	5	3	0	0	1	0	1	0
217	Link	9e11cc15cc6f7c8636f4fd3e0f9e8578811949d9	7	gui	2	7	5	2	0	0	0	0	0	0	0
226	Link	89a045c612ab6b130572697a3e2e827c6277d2ee	9	output	5	8	2	6	0	1	3	0	0	0	0
227	Link	3c26b278edd14dd909894bbe4346965e77013245	7.1	gui	5	31	7	24	19	3	22	0	0	0	0
228	Link	bcdab71c58f2ade300aa4cea23f0c9f728f26d88	4.2.2	output	1	11	1	10	0	1	4	0	0	0	0
248	Link	b4cb65b22c26c071734ede460adf4e6d001edbcd	9	gui	5	8	1	7	0	2	7	1	0	0	0
250	Link	0f39237e8e00957827762642b0c19347578ca421	6	gui	5	9	1	8	0	0	0	0	0	0	0
253	Link	fc44c9ee767d747699b0e80883974e14e9bd5a29	10	crash	2	5	1	4	0	1	3	0	0	0	0
256	Link	5a644f09aae5f7017369e69720486910082da11a	7.1	crash	5	22	7	15	11	3	14	0	0	0	0
266	Link	fc44c9ee767d747699b0e80883974e14e9bd5a29	10	output	6	14	10	4	0	0	0	1	1	0	0
271	Link	6e54497492cf0b8329f423bae5e1879b2ede4fd9	7.1.1	crash	2	12	4	8	0	2	8	0	0	0	0
272	Link	9e11cc15cc6f7c8636f4fd3e0f9e8578811949d9	10	output	6	9	1	8	0	1	4	0	0	0	0
273	Link	6d006a30219a3a1b42dd835119d08cb797ed6203	10	gui	3	15	8	7	4	0	0	1	0	0	0
274	Link	9e11cc15cc6f7c8636f4fd3e0f9e8578811949d9	7.1.1	output	9	7	0	7	3	1	2	0	0	0	0
275	Link	e19f6343624348dcb01486c4c70502004005583c	8.1	output	3	14	4	10	2	3	5	0	0	0	0
276	Link	b6957df14c7631f28f2ca38b38dcbb76ca0d370b	5	crash	5	5	1	4	1	0	0	1	1	1	0
277	Link	edac117922de5b278b2447df32d48c2d5d4a6a0b	5	gui	1	2	1	1	0	0	0	0	0	0	0