Handle Prod Timeout Worker Approve Timeout Errors

[owocki]

Description

Uses a solution found here to prevent production timeout errors.

adds a re-usable decorator for managing those timeouts

Refers/Fixes

Production timeout errors on approving users

Testing

from app.utils import timeout
import time

@timeout(2)
def foo():
    time.sleep(10)

foo()

will yield

---------------------------------------------------------------------------
TimeoutError                              Traceback (most recent call last)
<ipython-input-1-f4b9f2b0c14b> in <module>
      6     time.sleep(10)
      7
----> 8 foo()

/code/app/app/utils.py in func_wrapper(*args, **kwargs)
    508             async_result = pool.apply_async(item, args, kwargs)
    509             # raises a TimeoutError if execution exceeds max_timeout
--> 510             return async_result.get(max_timeout)
    511
    512         return func_wrapper

/usr/lib/python3.6/multiprocessing/pool.py in get(self, timeout)
    638         self.wait(timeout)
    639         if not self.ready():
--> 640             raise TimeoutError
    641         if self._success:
    642             return self._value

TimeoutError:

In [2]:

[owocki]

longer term it may be a good idea to move these jobs to celery instead of pageload

[owocki]

cc @danlipert for an async review. merging this bc its prod and ppl cant approve certain workers

[codecov]

Codecov Report

Merging #6238 into stable will increase coverage by 0.03%.
The diff coverage is 82.35%.

@@            Coverage Diff             @@
##           stable    #6238      +/-   ##
==========================================
+ Coverage   28.26%   28.29%   +0.03%     
==========================================
  Files         278      278              
  Lines       25240    25256      +16     
  Branches     3695     3695              
==========================================
+ Hits         7133     7147      +14     
+ Misses      17826    17824       -2     
- Partials      281      285       +4

Impacted Files	Coverage Δ
app/app/context.py	75.64% <ø> (ø)	⬆️
app/avatar/views_3d.py	9.59% <0%> (ø)	⬆️
app/app/utils.py	24.68% <100%> (+2.42%)	⬆️
app/dashboard/notifications.py	16.96% <66.66%> (+0.49%)	⬆️
...eting/management/commands/assemble_leaderboards.py	40.48% <0%> (ø)	⬆️
app/dashboard/views.py	11.35% <0%> (ø)	⬆️
...rketing/management/commands/no_applicants_email.py	0% <0%> (ø)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 84bf94b...0a25dfb. Read the comment docs.