Discussion / Support for Iron.io users.
See all
Members (196)

Stream

 
I can't find any documentation on this, but can I assume its possible to use IronMQ as a payload delivery mechanism for IronWorkers?
i.e have the workers fire up every 60 seconds and see if there are any jobs in the queue, then shutdown if not?
Thanks,
1
Steven Pearce's profile photoChad Arimura's profile photo
2 comments
 
Thanks for clearing that up for me. Can you also clarify that what I suggested is the correct approach for starting workers with this pattern?
i.e. using 
iron_worker schedule firstworker --run-every 60 etc. The worker should then check once and shutdown, it should not operate its own timer and keep checking the queue during a single instantiation of a worker..
Add a comment...

Abubaker Bilal

IronWorker  - 
 
I have uploaded a worker and ran it successfully, and my worker actually writes data into a file. How can I get/download that file?

Regards
Abubakar
1
Chad Arimura's profile photoAbubaker Bilal's profile photo
2 comments
 
Thanks alot, but when I try to put something in cache, I get this error:

"\xAE" from ASCII-8BIT to UTF-8 (Encoding::UndefinedConversionError)

Thanks for your help
Add a comment...
 
Just upgraded my #camel component for IronMQ https://github.com/pax95/camel-ironmq to the latest Camel and IronMQ java version. 
1
Add a comment...

Gerswin Lee

IronWorker  - 
 
hello, I have a problem but i'm not sure how to fix it when I run 

iron_worker upload vit                                                                                                                             
----> Creating client
        Project 'vit pcs' with id='534ca8b9c9abbc00050000b8'
----> Creating code package
        Found workerfile with path='vit.worker'
/var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:103:in `eval': (eval):4: unterminated string meets end of file (SyntaxError)
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:103:in `block (2 levels) in initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/fetcher.rb:78:in `call'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/fetcher.rb:78:in `fetch'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:93:in `block in initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:92:in `each'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:92:in `initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/cli.rb:78:in `new'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/cli.rb:78:in `upload'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/bin/iron_worker:116:in `<top (required)>'
        from /usr/local/bin/iron_worker:23:in `load'
        from /usr/local/bin/iron_worker:23:in `<main>'
1
Gerswin Lee's profile photoTravis Reeder's profile photo
2 comments
 
i just check, i forgot an " :@
Add a comment...
 
bugs/undocumented behaviour with beanstalk interface:

1, unable to "watch" any queue if the name includes "_". sample(copy & pasted from telnet):
put 0 0 0 58
oauth {token} {project_id}
INSERTED 0
watch abc_test
BAD_FORMAT

2, the watch command replies wrong watching count. sample:
put 0 0 0 58
oauth {token} {project_id}
INSERTED 0
watch abc
WATCHING 2

one more question:

is it possible to have impose access restrictions by token? e.g. a token that can only watch, reserve and delete jobs, not able to put jobs?
1
Evan Shaw's profile photoLinan Wang's profile photo
8 comments
 
Yes, there is a possible performance implication in watching an unused channel. It does not count as an extra API call, but it does cause the server to do a little more work, I don't know how measurable the difference would be.
Add a comment...

Travis Reeder
moderator

General  - 
 
New node scheduling package using Iron.io:

The Iron Scheduler is an ironio worker that queues configured tasks. It's the master in the master/slave setup that ironio recommends.
Iron Scheduler can be used as an independent worker, or you can use it programatically.
1
Add a comment...

Travis Reeder
moderator

IronMQ  - 
 
Camel component for IronMQ. 
1
Add a comment...

Ryan Crowe

General  - 
 
Heya guys, just got hired on at Twilio and they have all of the new employees create Apps! Now, I'm not a programmer/coder/dev etc. so I'm a little unfamiliar with how a lot of stuff works. I'm also not IN the office yet (I start on the 2nd of Dec) and I'm trying to knock out this app before I get there, so I can't ask any of  the engies for help.

I'm having a very basic problem right now. I am not sure how to manipulate my Ruby Interpreter to install iron_worker_ng - I'm not even sure how to look up the problem because I don't know what the problem is. Thoughts?
1
Ryan Crowe's profile photo
5 comments
 
That was it, Yury. Thanks! Keep an eye out here, I'll have more questions I'm sure.
Add a comment...

Travis Reeder
moderator

General  - 
 
A new .NET client for all the +Iron.io services, created by a user. Looks nice!
3
Add a comment...

Created by

 
I`d like to understand how ironio performs jobs.
I made simple job (ruby 2.1 stack, run at normal priority) with simple logging via puts. On my PC ruby script completes in 5-6 seconds

Worker job duration was 04:59 (299 seconds).
But then I looked into logs, I saw that all actial job was done in last 3 seconds (see logs below)

What operations were performed 4 minutes before? Wehe they accounted for total usage?

2014-05-17 19:03:04 +0000: Data from queue processed
2014-05-17 19:03:06 +0000: Got transactions data
2014-05-17 19:03:06 +0000: CSV generated 2014-05-17
19:03:07 +0000: CSV uploaded
Time elapsed: 2.947119372 seconds

Thanks in advance
1
Travis Reeder's profile photoАртём Прытков's profile photo
5 comments
 
Yes, I didn`t account for require gems block.
I ran benchmarks on require gems lines and it looks like it takes almost five minutes to require eaal gem.
          user        system           total              real
eaal 0.400000 0.120000 222.180000 (288.948259)
Add a comment...
 
I'm trying to run a fairly simple (crawl & scape) app locally using ironworker in Python. I can certainly run the top level task using "iron_worker run my.worker", but I get a HTTPError 400 if that task then enqueues any other tasks i.e using:

worker = IronWorker()
worker.queue(blah)

I'm not sure what extra scaffolding I need. Certainly the ability to run exactly the same code locally before uploading is a big requirement for me. While I could refactor into celery and use that I would rather stick with vanilla IronWorker, since celery seems like an unnecessary abstraction (although the @task annotation is rather nice).

Any thoughts?

Thanks,

Nick
1
Alexander S's profile photo
 
https://github.com/iron-io/iron_worker_python

Except 
worker = IronWorker()
worker.queue(code_name="HelloWorld")

You need just credentials, e.g. iron.json file
Add a comment...

Sabra Pratt

IronWorker  - 
 
For some reason, it's been impossible to get any help over the past couple of days with a problem that's causing worker jobs to fail. Perhaps we can get some help here? We're seeing errors like the one below:

"Error: create: Conflict, The name vm2306 is already assigned to d779d76ddc8a. You have to delete (or rename) that container to be able to assign vm2306 to a container again."

Any help would be greatly appreciated.

Thanks!
1
Sabra Pratt's profile photoTravis Reeder's profile photo
4 comments
 
Indeed, thanks.
Add a comment...

Sabra Pratt

IronWorker  - 
 
Hello,

Is iron.io planning to release support for multiple node versions on IronWorker? We've upgraded most of our codebase to v0.10 and are considering switching to another solution so that we don't have to continue to worry about maintaining backwards compatibility with 0.8.8 for shared modules. Any insight would be greatly appreciated!

Cheers
1
Sabra Pratt's profile photoChad Arimura's profile photo
5 comments
 
Thanks! We seem to be having big problems with it, though. :(
Add a comment...
 
Hi all
I have one question when I read Push Queue Settings

"push_type - multicast or unicast. Default is multicast. Set this to ‘pull’ to revert back to a pull queue."

unicast: message will be sent to one subscribers, right?
Sorry about my English
Best regards
Tuan
1
Tuấn Nguyễn Ngọc's profile photoTravis Reeder's profile photo
5 comments
 
It will be a random subscriber in the list to equally distribute load, not the first. 
Add a comment...
 
We are using multicast push queues to send Messages to multiple subscribers. A DNS reconfiguration disabled one of the endpoints for a few hours, as IronMQ not using exponential backoff for retries, this endpoint lost multiple messages. This makes me think that maybe I'm not using IronMQ properly. How should I do to have the guarantee that messages are delivered though a subscriber is temporarily unavailable?, Should I create a pull queue for each subscriber, and send a copy of the message to each queue so that each subscriber explicitly delete the message once obtained, or is there a simpler method?
1
Travis Reeder's profile photo
 
Have you seen the error queue feature? It will put undeliverable messages into another queue for you so you can deal with it later. 
Add a comment...
 
I am trying to implement push queues in .net but there are issues coming as i am not able get a 200 response from my private api. I am send json data to my api. Please help/
1
InfoQuest Solutions's profile photoTravis Reeder's profile photo
7 comments
 
Different use cases. Push queues are typically so you can push to yourself and do some "work" in your application rather than as an IronWorker. Or if the endpoint can accept the push queue message, then it's easier than building a worker for it. 

That said, we do plan to support custom headers for push queues at some point. 
Add a comment...
 
Hi there, my task on IronWorker takes 1s. to complete but seems to stop only after 1 hour.  How do i stop a task in Node.js?
1
Cyril Gaillard's profile photoYury Yantsevich's profile photo
2 comments
 
Geez that was quick. Thanks a lot!
Add a comment...
 
How can I use a newer version of nodejs? It is progressing at a furious pace. Is there something like buildpacks that exist for Heroku? 
1
Rick Cotter's profile photo
4 comments
 
Finally got back to this. It works great! There are a couple things I would love to see improved.

Just having workers work more like Heroku where the node version and modules listed in package.json would be ideal. Having/re-using Heroku's build packs would be awesome.

In the meantime:
 * It is a bit scary to use a DEB file that has been graciously provided just because I don't have knowledge of him. When its from Iron.io/Heroku I have immediate blind trust.
* I don't mind the build step except that a build worker is left behind clutering my dashboard. It would nice if that could just disappear. Poof!

Regardless, the fact that I can do what I want makes me happy. Thx!

Rick
Add a comment...