33 Commits

Author SHA1 Message Date
gabriel becker
19fe61b656 Addapt data fodler to accepet data engineering ocnvention https://towardsdatascience.com/the-importance-of-layered-thinking-in-data-engineering-a09f685edc71 2022-08-05 10:56:24 -03:00
Christopher Geis
1fbe58b219 Fixed: Typo in Makefile (#184)
Fixed typo in Makefile, section "Set up python interpreter environment": intalled --> installed
2019-09-23 08:49:26 -07:00
Jonathan Raviotta
7dcc59da43 Added source and destination to Make data target (#169) 2019-05-24 09:58:50 -07:00
Unai Zulaika
b8e8e1af74 Update Makefile (#150)
Work with pip from $PYTHON_INTERPRETER as recommended in 
https://packaging.python.org/guides/installing-using-pip-and-virtualenv/
2018-11-12 11:33:10 -08:00
Ikuo Suyama
752ddc7868 Rename make target show-help to help (#123)
* rename make target `show-help` to show_help

* rename show_help to help
2018-06-20 08:04:11 -07:00
Isaac Slavitt
be7f8d76b2
Merge pull request #86 from Midnighter/refactor/clean
refactor: extend the `make clean` command
2018-02-13 17:12:49 -05:00
Isaac Slavitt
79e5913563
Merge pull request #84 from Midnighter/feat/requirements
feat: upgrade essentials before requirement
2018-02-13 17:11:46 -05:00
Moritz E. Beber
0ab519ab5f refactor: restrict linting to src directory 2017-07-21 15:23:21 +02:00
Moritz E. Beber
bd1a0de877 feat: upgrade essentials before requirement 2017-07-21 15:18:50 +02:00
Moritz E. Beber
96c61fcef0 refactor: extend the make clean command 2017-07-21 15:16:13 +02:00
Kasper Primdal Lauritzen
2bafb83110 Use latest stable python3 in conda create (#78) 2017-07-02 13:15:16 -05:00
Paul Harrison
934a98c11d Add optional argument for using AWS credentials profile.
Update docs.

Update tests. No need to include __pycache__ directory.

Update .gitignore to ignore test cache output.
2017-06-22 21:45:54 +01:00
Isaac Slavitt
f3980db66c Fix self documenting make on Linux, close #67 2017-03-27 15:37:41 +02:00
Isaac Slavitt
5cc3192a52 Add PROJECT_DIR absolute path as variable in Makefile, per #65 2017-03-13 16:27:17 -04:00
Keld Lundgaard
a6a8c66e2d Check for conda before using it to create an environment. 2017-02-26 11:18:46 -06:00
Matt Fortier
adf935ba53 fixed minor formatting issue in Makefile (#61) 2017-02-04 20:59:19 -07:00
Luca Verginer
5569270724 Changed findstr to findstring (#57)
On Mac with GNU Make 3.81 I had to change this line to get the makefile to correctly read the python version number
2016-11-10 08:19:45 -05:00
Peter Bull
1caa67be43 Detect conda and support conda envs; tweaks for vanilla virtualenv (#51)
* OSX Junk in gitignore

* Support conda envs by default

* Make it run on vanilla Ubuntu
2016-10-16 10:01:37 -04:00
Colin Sullivan
ae2b54e738 install virtualenvwrapper by default, and use project defined python interpreter. Also make requirements command output verbose 2016-10-10 17:28:44 -04:00
Colin Sullivan
a3785c9180 small naming fix 2016-10-05 16:03:25 -04:00
Colin Sullivan
d13bc88ab0 add parameter to specify python interpreter and commands to create and test virtual environments 2016-10-05 15:16:42 -04:00
Colin Sullivan
690241a8a9 Added self-documenting comments and default Rule to list commands with descriptions 2016-10-05 13:38:34 -04:00
Harald Wartig
1a2d598725 Exclude docs/conf.py from linting.
Running `make lint` after initializing a fresh project complains about errors in `docs/conf.py`. Which is kinda awkward for the user as he didn't write any code yet and already has errors. As this file is autogenerated I think it is best to exclude it from linting rather than fixing the errors.
2016-08-06 11:07:13 +02:00
Michael Bell
de9b34052d Removed --recursive flag from s3 sync in the Makefile 2016-05-24 16:53:17 -04:00
Peter Bull
03a96219ea Update to awscli so Python 3 works
Closes #23
2016-05-21 16:51:34 -04:00
Peter Bull
7d8086ea87 Wrong path in Make data 2016-05-02 22:35:49 -04:00
Cody Rioux
d3d7b74ff9 Added virtualenv directories to flake8 exclude list. 2016-04-29 14:17:38 -07:00
Cody Rioux
fa3c332415 Silenced pip on installation of requirements. 2016-04-29 14:17:08 -07:00
Peter Bull
4e29e24bfe Make s3 bucket variable work
bonus: instruction not to include s3:// in the bucket name
2015-11-03 13:58:35 -05:00
isms
6e0dc39a6c Add flake8 linting 2015-11-02 09:02:49 -05:00
isms
47f554a2ea Add requirements target 2015-10-30 16:05:08 -04:00
isms
809b281c58 Add Makefile entries for syncing data to S3 2015-10-30 15:19:25 -04:00
isms
004f0635a4 Initial commit 2015-10-30 15:09:43 -04:00