Discussion / Support for Iron.io users.
See all
Members (247)
Iron.io's profile photo
Travis Reeder's profile photo
Adam Parker's profile photo
Adam Wiggall's profile photo
Albert Chu's profile photo
Auction markete's profile photo
Christopher Brodt's profile photo
Arvind verma's profile photo
Alexandr Martynov's profile photo
Brent Jenkins's profile photo
Alfonso Garza's profile photo
Cyril Oblikov's profile photo
Carl Tanner's profile photo
ALW ALW's profile photo
Clint Nelissen's profile photo
Aman Rana's profile photo
Brad Jones's profile photo
Bo Coughlin's profile photo
Ben Ellis's profile photo
Dan Dennedy's profile photo
Chad Arimura's profile photo
Antonio Cunha Santos's profile photo
Brenton House's profile photo
Arvind kumar verma's profile photo

Stream

Join this community to post or comment

Travis Reeder
moderator

IronWorker  - 
 
Lumen Iron Worker
What and why
A worker is a great way to run tasks as needed taking the load off your applications server and greatly speeding up the process of a task as you can run numerous workers at once.
1
Add a comment...
 
I have a shell script worker that needs to queue another worker when it's finished. It doesn't seem like the iron_worker CLI is available from the binary worker environment? Is there a suggested way to queue up workers from a shell worker?
1
Travis Reeder's profile photoLaura Weindorf (lauracw100)'s profile photo
5 comments
 
Oh, yeah! Thank you, Travis. I like that because then I don't have to hardcode the endpoint into my script :-D.
Add a comment...
 
Did someone use IronMQ with Java that can help me? An HHTP error is giving me and I research about it but I couldn't solve it. I don't know if this is the place but I'm going crazy D:
1
Ken Fromm's profile photo
 
Check in with us on in support chat channel (https://hud.iron.io/users/support) or at support@iron.io.
Add a comment...
 
anyone know how to auth messages using backburner (beanstalk client for Ruby on Rails) ?
1
Add a comment...
 
Plz guide me in implementing worker server in laravel php and iron.io to send emails 
1
1
Ken Fromm's profile photoDarshan kumar's profile photoAlfred Nutile's profile photo
2 comments
 
Thank you so much for replying :)
 but what I am doing is created a interface for queue-push,delete queue on job id and update and list the content of queue to be done. 
But not getting what to do for implementing interface for sending mail through worker server
Add a comment...
 
I`d like to understand how ironio performs jobs.
I made simple job (ruby 2.1 stack, run at normal priority) with simple logging via puts. On my PC ruby script completes in 5-6 seconds

Worker job duration was 04:59 (299 seconds).
But then I looked into logs, I saw that all actial job was done in last 3 seconds (see logs below)

What operations were performed 4 minutes before? Wehe they accounted for total usage?

2014-05-17 19:03:04 +0000: Data from queue processed
2014-05-17 19:03:06 +0000: Got transactions data
2014-05-17 19:03:06 +0000: CSV generated 2014-05-17
19:03:07 +0000: CSV uploaded
Time elapsed: 2.947119372 seconds

Thanks in advance
1
Yury Yantsevich (Featalion)'s profile photo
8 comments
 
ah, it is old thread, sorry...
Add a comment...

Nick Brook

IronWorker  - 
 
I'm trying to run a fairly simple (crawl & scape) app locally using ironworker in Python. I can certainly run the top level task using "iron_worker run my.worker", but I get a HTTPError 400 if that task then enqueues any other tasks i.e using:

worker = IronWorker()
worker.queue(blah)

I'm not sure what extra scaffolding I need. Certainly the ability to run exactly the same code locally before uploading is a big requirement for me. While I could refactor into celery and use that I would rather stick with vanilla IronWorker, since celery seems like an unnecessary abstraction (although the @task annotation is rather nice).

Any thoughts?

Thanks,

Nick
1
Alexander S's profile photo
 
https://github.com/iron-io/iron_worker_python

Except 
worker = IronWorker()
worker.queue(code_name="HelloWorld")

You need just credentials, e.g. iron.json file
Add a comment...

Sabra Pratt

IronWorker  - 
 
For some reason, it's been impossible to get any help over the past couple of days with a problem that's causing worker jobs to fail. Perhaps we can get some help here? We're seeing errors like the one below:

"Error: create: Conflict, The name vm2306 is already assigned to d779d76ddc8a. You have to delete (or rename) that container to be able to assign vm2306 to a container again."

Any help would be greatly appreciated.

Thanks!
1
Travis Reeder's profile photoSabra Pratt's profile photo
4 comments
 
Indeed, thanks.
Add a comment...

Sabra Pratt

IronWorker  - 
 
Hello,

Is iron.io planning to release support for multiple node versions on IronWorker? We've upgraded most of our codebase to v0.10 and are considering switching to another solution so that we don't have to continue to worry about maintaining backwards compatibility with 0.8.8 for shared modules. Any insight would be greatly appreciated!

Cheers
1
Chad Arimura's profile photoSabra Pratt's profile photo
5 comments
 
Thanks! We seem to be having big problems with it, though. :(
Add a comment...
 
Hi all
I have one question when I read Push Queue Settings

"push_type - multicast or unicast. Default is multicast. Set this to ‘pull’ to revert back to a pull queue."

unicast: message will be sent to one subscribers, right?
Sorry about my English
Best regards
Tuan
2
Tuấn Nguyễn Ngọc's profile photoTravis Reeder's profile photo
5 comments
 
It will be a random subscriber in the list to equally distribute load, not the first. 
Add a comment...
 
We are using multicast push queues to send Messages to multiple subscribers. A DNS reconfiguration disabled one of the endpoints for a few hours, as IronMQ not using exponential backoff for retries, this endpoint lost multiple messages. This makes me think that maybe I'm not using IronMQ properly. How should I do to have the guarantee that messages are delivered though a subscriber is temporarily unavailable?, Should I create a pull queue for each subscriber, and send a copy of the message to each queue so that each subscriber explicitly delete the message once obtained, or is there a simpler method?
1
Travis Reeder's profile photo
 
Have you seen the error queue feature? It will put undeliverable messages into another queue for you so you can deal with it later. 
Add a comment...

Created by

Kapil Sachdeva

IronWorker  - 
 
Multi-tenant & secure solution using firebase and ironworker
How to use open technology stacks and a set of cloud services & platforms (that provide free tier) to create a multi-tenant, real time, secure and scalable solution. We would use Firebase, IronWorker and Ionicframework to build the solution
2
Add a comment...
 
Hi all,

I searched a lot but couldn't found any description on properties of responses that are being sent by REST API (http://dev.iron.io/mq/reference/api/#responses) Almost all properties of responses are self explanatory but some properties needs to be described. Let me mention some of them;

In response of GET /projects/{Project ID}/queues/{Queue Name}/messages/{Message ID}/subscribers request, what is property ID? (this is not message ID as I have checked it. In case of uni-cast push queue it is the same number as message_id+1)
In response of GET /projects/{Project ID}/queues/{Queue Name}/messages/{Message ID} request, what is property reserved_count?

In response of GET /projects/{Project ID}/queues/{Queue Name} request, what is property size? (It looks to be queue size from its value but again what is queue size? Queue Size on my Dashboard always displays zero)

As per my understanding if a message is retrying 2nd or 3rd time its retries_remaining should be equal to retries_total - number of retries attempts. But this is not case. Every time I have seen that retries_remaining is not changing. What are the cases in which retries_remaining will change?

After the message is tried "retries_total" number of times, message "status" should be changed to "error" but it remains "retrying"
Is there any log of message routing? means, if a message is first send to subscriber 1 but not received 200 in response. The same message will be then send to other subscriber say subscriber 2. 


Regards,
1
Add a comment...

Braxton Beyer

IronWorker  - 
 
how do I require a file from a subdirectory in my worker and have it live in the same subdirectory when built?
1
Chad Arimura's profile photo
 
Check out the "file" keyword in the following doc:  http://dev.iron.io/worker/reference/dotworker/#syntax_reference 

You can use file in your .worker file like this:

file source, destination

file 'my_dir/my_file', 'my_dir/my_file'

Should work but maybe +Stephen Nguyen can double check.
Add a comment...
 
I can't find any documentation on this, but can I assume its possible to use IronMQ as a payload delivery mechanism for IronWorkers?
i.e have the workers fire up every 60 seconds and see if there are any jobs in the queue, then shutdown if not?
Thanks,
1
Joseph Szobody's profile photoTravis Reeder's profile photo
6 comments
 
Hey guys, Steven, the scheduled way is a good way to do it. Also, our alerts feature is a great way to auto scale workers based on how big your queue is getting: http://dev.iron.io/mq/reference/queue_alerts/

To use alerts, you'd basically set up this configuration:

- make a push queue with an ironworker:// subscriber.
- set alerts on your main queue with a target to the push queue (from line above)

This will basically fire up an IronWorker whenever an alert is triggered. 
Add a comment...

Abubaker Bilal

IronWorker  - 
 
I have uploaded a worker and ran it successfully, and my worker actually writes data into a file. How can I get/download that file?

Regards
Abubakar
1
Chad Arimura's profile photoAbubaker Bilal's profile photo
2 comments
 
Thanks alot, but when I try to put something in cache, I get this error:

"\xAE" from ASCII-8BIT to UTF-8 (Encoding::UndefinedConversionError)

Thanks for your help
Add a comment...
 
Just upgraded my #camel component for IronMQ https://github.com/pax95/camel-ironmq to the latest Camel and IronMQ java version. 
camel-ironmq - camel ironmq component
1
Add a comment...

Gerswin Lee

IronWorker  - 
 
hello, I have a problem but i'm not sure how to fix it when I run 

iron_worker upload vit                                                                                                                             
----> Creating client
        Project 'vit pcs' with id='534ca8b9c9abbc00050000b8'
----> Creating code package
        Found workerfile with path='vit.worker'
/var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:103:in `eval': (eval):4: unterminated string meets end of file (SyntaxError)
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:103:in `block (2 levels) in initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/fetcher.rb:78:in `call'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/fetcher.rb:78:in `fetch'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:93:in `block in initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:92:in `each'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:92:in `initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/cli.rb:78:in `new'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/cli.rb:78:in `upload'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/bin/iron_worker:116:in `<top (required)>'
        from /usr/local/bin/iron_worker:23:in `load'
        from /usr/local/bin/iron_worker:23:in `<main>'
1
Travis Reeder's profile photoGerswin Lee's profile photo
2 comments
 
i just check, i forgot an " :@
Add a comment...
 
bugs/undocumented behaviour with beanstalk interface:

1, unable to "watch" any queue if the name includes "_". sample(copy & pasted from telnet):
put 0 0 0 58
oauth {token} {project_id}
INSERTED 0
watch abc_test
BAD_FORMAT

2, the watch command replies wrong watching count. sample:
put 0 0 0 58
oauth {token} {project_id}
INSERTED 0
watch abc
WATCHING 2

one more question:

is it possible to have impose access restrictions by token? e.g. a token that can only watch, reserve and delete jobs, not able to put jobs?
1
Linan Wang's profile photoEvan Shaw's profile photo
8 comments
 
Yes, there is a possible performance implication in watching an unused channel. It does not count as an extra API call, but it does cause the server to do a little more work, I don't know how measurable the difference would be.
Add a comment...

Travis Reeder
moderator

General  - 
 
New node scheduling package using Iron.io:

The Iron Scheduler is an ironio worker that queues configured tasks. It's the master in the master/slave setup that ironio recommends.
Iron Scheduler can be used as an independent worker, or you can use it programatically.
Schedule and queue ironio worker tasks.
1
Add a comment...