Commit dfb5aaa
committed
Speed up integration tests
The integration tests can be quite slow to run. This is because we are
actually creating a test program as a string, dumping that string into a
temporary file, shelling out to another instance of Ruby/RSpec, running
the file inside of that process, then performing a test on the output.
We have a lot of integration tests, and running the test suite on Travis
can take around 20 minutes. In my opinion, that's way too long for a gem
that isn't terribly large.
This commit attempts to alleviate this pain point by introducing a
development dependency on Zeus. [Zeus] is a "code preloader" that was
primarily designed to speed up development within a Rails app, as it can
preload your Rails environment so that your tests will run faster. While
Zeus has largely been superceded by Spring, it is still a valuable tool
and can also be used for non-Rails applications.
How does Zeus work? The Zeus server is a persistent process that
establishes an environment by running Ruby code of your choosing, then
awaits a connection from the Zeus client, which will then run some code
within that environment. Zeus employs forking to keep the environment
code in memory so that it does not need to be re-run. (This is not the
best description, but there is more information on the website if you
want to learn more.)
The way that we use Zeus is that we create an environment where
`super_diff` is already required and — for tests that need ActiveRecord
— where ActiveRecord is already required too. The integration tests will
then re-use this environment (the code that's run in this environment is
specified in the test itself).
After all is said and done, this ends up speeding up all integration
tests by a little over 2x.
How do you get this goodness? I've added a `bin/start-dev` script which
will run the persistent Zeus server by way of `zeus start`. You will
want to run this command in a separate tab. After this, you can then run
`bin/rspec spec/integration/...` and you should see the speed bump.
[Zeus]: https://github.com/burke/zeus1 parent 15cf285 commit dfb5aaa
File tree
32 files changed
+794
-500
lines changed- bin
- config
- gemfiles
- spec
- integration/rspec
- support
- integration
- matchers
- test_programs
- models/active_record
- support
32 files changed
+794
-500
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| 6 | + | |
| 7 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
6 | | - | |
| 6 | + | |
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
16 | | - | |
| 16 | + | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | | - | |
| 20 | + | |
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
| 32 | + | |
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
| |||
56 | 56 | | |
57 | 57 | | |
58 | 58 | | |
59 | | - | |
| 59 | + | |
60 | 60 | | |
61 | 61 | | |
62 | 62 | | |
| |||
77 | 77 | | |
78 | 78 | | |
79 | 79 | | |
80 | | - | |
| 80 | + | |
81 | 81 | | |
82 | 82 | | |
83 | 83 | | |
84 | | - | |
| 84 | + | |
85 | 85 | | |
86 | 86 | | |
87 | 87 | | |
| |||
91 | 91 | | |
92 | 92 | | |
93 | 93 | | |
| 94 | + | |
| 95 | + | |
94 | 96 | | |
95 | 97 | | |
96 | 98 | | |
| |||
99 | 101 | | |
100 | 102 | | |
101 | 103 | | |
| 104 | + | |
| 105 | + | |
102 | 106 | | |
103 | 107 | | |
104 | 108 | | |
| |||
153 | 157 | | |
154 | 158 | | |
155 | 159 | | |
156 | | - | |
| 160 | + | |
157 | 161 | | |
158 | 162 | | |
159 | 163 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
4 | 10 | | |
5 | 11 | | |
6 | 12 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
39 | 59 | | |
40 | 60 | | |
41 | 61 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
| 12 | + | |
16 | 13 | | |
17 | 14 | | |
18 | 15 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
| 7 | + | |
8 | 8 | | |
9 | 9 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
11 | | - | |
12 | | - | |
13 | | - | |
| 10 | + | |
14 | 11 | | |
15 | 12 | | |
16 | 13 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
2 | | - | |
3 | | - | |
4 | | - | |
5 | | - | |
6 | | - | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | | - | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | 1 | | |
31 | 2 | | |
32 | 3 | | |
| |||
43 | 14 | | |
44 | 15 | | |
45 | 16 | | |
46 | | - | |
47 | | - | |
| 17 | + | |
| 18 | + | |
48 | 19 | | |
49 | 20 | | |
50 | 21 | | |
51 | | - | |
52 | | - | |
| 22 | + | |
53 | 23 | | |
54 | | - | |
| 24 | + | |
55 | 25 | | |
56 | 26 | | |
57 | 27 | | |
58 | | - | |
59 | | - | |
60 | | - | |
61 | | - | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
62 | 32 | | |
63 | | - | |
| 33 | + | |
64 | 34 | | |
65 | 35 | | |
66 | | - | |
67 | | - | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
68 | 51 | | |
69 | 52 | | |
70 | 53 | | |
| 54 | + | |
71 | 55 | | |
72 | | - | |
| 56 | + | |
73 | 57 | | |
74 | 58 | | |
75 | 59 | | |
76 | | - | |
| 60 | + | |
77 | 61 | | |
78 | 62 | | |
79 | 63 | | |
| |||
84 | 68 | | |
85 | 69 | | |
86 | 70 | | |
87 | | - | |
88 | | - | |
89 | | - | |
90 | | - | |
| 71 | + | |
91 | 72 | | |
92 | 73 | | |
93 | 74 | | |
94 | | - | |
95 | | - | |
96 | | - | |
97 | 75 | | |
98 | 76 | | |
0 commit comments