Commit graph

963 commits

Author SHA1 Message Date
Judy Ngai
1f29dee93c qpx express flight agent 2016-03-23 17:49:45 -04:00
Dominik Sander
075545191a Merge pull request #1364 from kreuzwerker/feature/json-parse
Add JsonParseAgent
2016-03-22 10:18:57 +01:00
Dominik Sander
e2981b0ded Add JsonParseAgent
It parses a JSON string and emits the data in a new event
2016-03-22 10:05:43 +01:00
Andrew Cantino
7a4ebee73d Merge pull request #1354 from Jngai/aftership
Aftership
2016-03-20 17:25:23 -07:00
Dominik Sander
9d1bfeb778 Make FtpsiteAgent FileHandling aware
It emits file_pointers for changed files and writes received events to the FTP server.
2016-03-18 20:43:35 +01:00
Dominik Sander
74c4a2d5b8 Add CsvAgent which parses CSV and serializes data to CSV 2016-03-18 20:43:35 +01:00
Dominik Sander
40835e981f Add S3Agent to read and write files to S3 buckets 2016-03-18 20:43:35 +01:00
Dominik Sander
89629ec216 Add ReadFileAgent, it consumes a file_pointer and emits the contents as a string 2016-03-18 20:43:35 +01:00
Dominik Sander
38f1044078 Add LocalFileAgent and introduce concept to handle files
The idea is to have source agents (`LocalFile` and `S3Agent` for now), which just emit a "file_pointer" and consuming
agents (`ReadFile` and `CsvAgent`) which get access to an `IO` object to actually access the file contents. This way we
do not have to pass megabytes of data through the database and the consuming agents can work with relatively unlimited
file sizes.
2016-03-18 20:43:28 +01:00
Dominik Sander
bf7c2feba4 Merge pull request #1330 from kreuzwerker/feature/user-admin-interface
Admin user management
2016-03-17 21:02:27 +01:00
Dominik Sander
c0c74113bf Admins should not be able to deactivate their own accounts 2016-03-17 20:47:57 +01:00
Dominik Sander
8508928943 Admins can deactivate user accounts 2016-03-17 20:47:51 +01:00
Dominik Sander
ee1ebea830 Allow to configure various devise settings in .env 2016-03-17 20:47:45 +01:00
Dominik Sander
4722ebfe4e Add admin user management interface 2016-03-17 20:36:07 +01:00
Judy Ngai
b28c284923 removed extra stub request 2016-03-17 11:22:56 -04:00
Judy Ngai
0ead3673b4 lots of clarifications and providing full api path 2016-03-17 11:19:51 -04:00
Judy Ngai
4fd8c6b1f9 modified test after agent modification 2016-03-16 11:08:15 -04:00
Judy Ngai
75bbb208f6 test completed 2016-03-15 13:44:24 -04:00
Judy Ngai
f947ba49db testing the urls returning correctly 2016-03-15 13:00:40 -04:00
Judy Ngai
71926e2cd7 half of the spec created 2016-03-15 12:45:23 -04:00
Dominik Sander
c1b249689c Merge pull request #1347 from dsander/increase-capybara-timeout
Increase capybara default_max_wait_time to 60 seconds
2016-03-14 21:34:37 +01:00
Dominik Sander
43463b5518 Increase capybara/poltergeist timeout to 60 seconds
The default wait time of 2 seconds produced false positives on slow test runners.
2016-03-14 21:22:04 +01:00
Andrew Cantino
c436315826 Rescue and log email sending errors 2016-03-12 13:45:08 -08:00
Dominik Sander
c52a508d4d Fix TwitterStreamAgent specs and mock puts calls 2016-03-12 10:59:23 +01:00
Dominik Sander
5dc9fac011 Merge pull request #1329 from kreuzwerker/feature/json-filter
Add json liquid filter to serialize data to a JSON string
2016-03-08 12:35:12 +01:00
Andrew Cantino
78cbf56c4d Merge pull request #1325 from Jngai/add_text_html_option_to_email_agent
added options to send plain or html emails
2016-03-06 22:41:56 -08:00
Andrew Cantino
1faf950273 Merge pull request #1323 from prathyush/master
Agent for Boxcar.io
2016-03-06 15:19:09 -08:00
Dominik Sander
785ba7091f Add json liquid filter to serialize data to a JSON string
Example: `{{ data | json}}` takes the object of the payloads data key and converts it to JSON
2016-03-03 13:01:08 +01:00
Andrew Cantino
8bef0f4ae3 Merge pull request #1321 from Jngai/add_home_timeline_option_to_twitter_user_agent
Add home timeline option to twitter user agent
2016-03-01 22:52:51 -08:00
Judy Ngai
11480bbb7b test added 2016-03-01 11:43:22 -05:00
Judy Ngai
87760f1135 content type check test 2016-02-29 16:31:38 -05:00
Judy Ngai
ae8405efc6 improved and added tests to spec refactored agent 2016-02-29 10:40:02 -05:00
Judy Ngai
8942f74e77 spec and agent refactoring 2016-02-26 23:16:20 -05:00
Prathyush Thota
8a2e67a32a Fixed an error in the spec file 2016-02-27 04:17:06 +05:30
Prathyush Thota
639ef3b55a Fixed the spec file 2016-02-27 04:15:12 +05:30
Prathyush Thota
3afe00daf8 Added RSpec spec 2016-02-27 03:16:53 +05:30
Andrew Cantino
1aaad3b7ef Merge pull request #1209 from darrencauthon/ping_agent
Http Status agent
2016-02-26 12:07:31 -08:00
Judy Ngai
91476dc0fe fixed spec test passed 2016-02-25 22:03:54 -05:00
Judy Ngai
2690bc11f4 probably better 2016-02-25 17:28:43 -05:00
Judy Ngai
6f21fe24d6 updated spec 2016-02-25 17:06:40 -05:00
Judy Ngai
a61f70b896 put in all of dsander suggestion 2016-02-25 15:59:34 -05:00
Judy Ngai
5604c17696 added test to check home time line 2016-02-25 14:09:50 -05:00
Darren Cauthon
18b0107e50 Add the http status agent. 2016-02-25 07:12:47 -06:00
Judy Ngai
19dc6e3324 make indentation perfect 2016-02-24 12:46:10 -05:00
Michał (Gore) Półrolniczak
70919fc24e the next nine commits
squashing 36 commits into one giant commit
Create twitter_favorite agent

Agent that returns favorite tweet of given user

Added history, number and clean up

'history' is buffer to hold historical tweet.id this can be used for memory optimization, 'number' is number of latest tweets that Agent retrieve.

Update to use Array, Clean code, renamed

I put Array into 'memory' to make it simpler, that clean up some not needed code. Hope it will be included to make it more wide used.

Fix'd typos

Fix'd typos #2

Fix'd ref on null object

Fixed `undefined method `include' for nil:NilClass`

Added Pocket variable

Added POCKET_OAUTH_KEY for Pocket support

Adding first scraps

pocket_concerns.rb scrap

something for pocket

Added Pocket gem

Revert "Added Pocket gem"

This reverts commit 701ecd5393b05a8926dba9e45834592dd09774ef.

Revert "pocket_concerns.rb scrap"

This reverts commit cd1b3a751dcb3ca6f36746cfddb23b3e889fb986.

Revert "Adding first scraps"

This reverts commit 4e63b1302364218d46c062f915e1023e63886f43.

Revert "Added Pocket variable"

This reverts commit bb390680bb7bfd6cb424a283d7103dbd15966538.

renamed file with agent to make file names consistent

added in factory girl and disabled master fixture replacement

some work on spec file

spec one fail one success

rm factory girl

cleaner specs

twitter favorites spec half done

deleted extra agent

comment out one of the test

twitter favorite specs

a more proper date

changed back to starting at

fixed number to history typo

altered memory in agent

shifting memory down by one instead of halfing memory last seen

removed typo

replaced all mockobject with agent

fixed indentation issue

setting up event payload information and switched to tectonic

asserted payload looks what it is suppose to

reduced 5 events to 1 event

updated tweets json and spec file

checking out my db schema

rm date from options

rm last test

removed saved from check method

put back last spec and test passed

changed date make it change by 3 instead

moved memory shifting into the loop

moved memory last seen outside of the loop
2016-02-24 12:18:48 -05:00
Andrew Cantino
69e224e49d Avoid raising an error on missing credential, validation should catch it 2016-02-14 10:59:04 -08:00
Dominik Sander
94edebef9c Merge pull request #1254 from dsander/add-no-bulk-receive
Add no_bulk_receive! option to ensure each event is processed individually
2016-02-12 10:47:58 +01:00
Andrew Cantino
3fd30c9004 Merge pull request #1273 from International/allow-error-codes-to-be-considered-succesfull
#1272 Allow error codes, such as 404, to be considered successful
2016-02-07 20:14:51 -08:00
Andrew Cantino
068a0be26e Merge pull request #1275 from omniscopeio/capybara
Adds support for writing Capybara specs
2016-02-07 20:13:22 -08:00
Dominik Sander
a958b15f18 Add no_bulk_receive! option to ensure each event is processed individually
no_bulk_receive! ensures that agents which connect to an external only receive
one event per job this ensures that failed and retried jobs do not run twice
for the same event.

Fixes #1226
2016-02-07 23:37:43 +01:00