Discussion / Support for Iron.io users.
See all
Members (285)
Travis Reeder's profile photo
Iron.io's profile photo
Dimitri Roche's profile photo
Arvind verma's profile photo
Muhammad Zakaria's profile photo
Edmundas Mišeikis's profile photo
Lee Tom's profile photo
Linan Wang's profile photo
Joseph Szobody's profile photo
Yelli Cazalon's profile photo
Shantanu Gera's profile photo
Mike Carifio's profile photo
Yasir Mirza's profile photo
Nicolas Kermarc's profile photo
my ahmed TMA's profile photo
Rui Barbosa's profile photo
Peter Fox's profile photo
Ana Rajpoot's profile photo
gusindra divanatha's profile photo
Aliaksei Rubanau's profile photo
Hareem Haque's profile photo
Ulises Garcia (Uly 809)'s profile photo
Marcus Andersson's profile photo
Jason Thigpen's profile photo

Stream

Join this community to post or comment

Travis Reeder
moderator

IronWorker  - 
 
Lumen Iron Worker
What and why
A worker is a great way to run tasks as needed taking the load off your applications server and greatly speeding up the process of a task as you can run numerous workers at once.
1
Add a comment...
 
I have a shell script worker that needs to queue another worker when it's finished. It doesn't seem like the iron_worker CLI is available from the binary worker environment? Is there a suggested way to queue up workers from a shell worker?
1
Travis Reeder's profile photoLaura Weindorf (lauracw100)'s profile photo
5 comments
 
Oh, yeah! Thank you, Travis. I like that because then I don't have to hardcode the endpoint into my script :-D.
Add a comment...
 
Did someone use IronMQ with Java that can help me? An HHTP error is giving me and I research about it but I couldn't solve it. I don't know if this is the place but I'm going crazy D:
1
Ken Fromm's profile photo
 
Check in with us on in support chat channel (https://hud.iron.io/users/support) or at support@iron.io.
Add a comment...
 
anyone know how to auth messages using backburner (beanstalk client for Ruby on Rails) ?
1
Add a comment...
 
Plz guide me in implementing worker server in laravel php and iron.io to send emails 
1
1
Ken Fromm's profile photoDarshan kumar's profile photo
2 comments
 
Thank you so much for replying :)
 but what I am doing is created a interface for queue-push,delete queue on job id and update and list the content of queue to be done. 
But not getting what to do for implementing interface for sending mail through worker server
Add a comment...
 
I`d like to understand how ironio performs jobs.
I made simple job (ruby 2.1 stack, run at normal priority) with simple logging via puts. On my PC ruby script completes in 5-6 seconds

Worker job duration was 04:59 (299 seconds).
But then I looked into logs, I saw that all actial job was done in last 3 seconds (see logs below)

What operations were performed 4 minutes before? Wehe they accounted for total usage?

2014-05-17 19:03:04 +0000: Data from queue processed
2014-05-17 19:03:06 +0000: Got transactions data
2014-05-17 19:03:06 +0000: CSV generated 2014-05-17
19:03:07 +0000: CSV uploaded
Time elapsed: 2.947119372 seconds

Thanks in advance
1
Yury Yantsevich (Featalion)'s profile photo
8 comments
 
ah, it is old thread, sorry...
Add a comment...

Nick Brook

IronWorker  - 
 
I'm trying to run a fairly simple (crawl & scape) app locally using ironworker in Python. I can certainly run the top level task using "iron_worker run my.worker", but I get a HTTPError 400 if that task then enqueues any other tasks i.e using:

worker = IronWorker()
worker.queue(blah)

I'm not sure what extra scaffolding I need. Certainly the ability to run exactly the same code locally before uploading is a big requirement for me. While I could refactor into celery and use that I would rather stick with vanilla IronWorker, since celery seems like an unnecessary abstraction (although the @task annotation is rather nice).

Any thoughts?

Thanks,

Nick
1
Alexander S's profile photo
 
https://github.com/iron-io/iron_worker_python

Except 
worker = IronWorker()
worker.queue(code_name="HelloWorld")

You need just credentials, e.g. iron.json file
Add a comment...

Gerswin Lee

IronWorker  - 
 
hello, I have a problem but i'm not sure how to fix it when I run 

iron_worker upload vit                                                                                                                             
----> Creating client
        Project 'vit pcs' with id='534ca8b9c9abbc00050000b8'
----> Creating code package
        Found workerfile with path='vit.worker'
/var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:103:in `eval': (eval):4: unterminated string meets end of file (SyntaxError)
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:103:in `block (2 levels) in initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/fetcher.rb:78:in `call'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/fetcher.rb:78:in `fetch'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:93:in `block in initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:92:in `each'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/code/base.rb:92:in `initialize'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/cli.rb:78:in `new'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/lib/iron_worker_ng/cli.rb:78:in `upload'
        from /var/lib/gems/1.9.1/gems/iron_worker_ng-1.4.2/bin/iron_worker:116:in `<top (required)>'
        from /usr/local/bin/iron_worker:23:in `load'
        from /usr/local/bin/iron_worker:23:in `<main>'
1
Travis Reeder's profile photoGerswin Lee's profile photo
2 comments
 
i just check, i forgot an " :@
Add a comment...
 
Hi all
I have one question when I read Push Queue Settings

"push_type - multicast or unicast. Default is multicast. Set this to ‘pull’ to revert back to a pull queue."

unicast: message will be sent to one subscribers, right?
Sorry about my English
Best regards
Tuan
2
Tuấn Nguyễn Ngọc's profile photoTravis Reeder's profile photo
5 comments
 
It will be a random subscriber in the list to equally distribute load, not the first. 
Add a comment...
 
We are using multicast push queues to send Messages to multiple subscribers. A DNS reconfiguration disabled one of the endpoints for a few hours, as IronMQ not using exponential backoff for retries, this endpoint lost multiple messages. This makes me think that maybe I'm not using IronMQ properly. How should I do to have the guarantee that messages are delivered though a subscriber is temporarily unavailable?, Should I create a pull queue for each subscriber, and send a copy of the message to each queue so that each subscriber explicitly delete the message once obtained, or is there a simpler method?
1
Travis Reeder's profile photo
 
Have you seen the error queue feature? It will put undeliverable messages into another queue for you so you can deal with it later. 
Add a comment...
 
I am trying to implement push queues in .net but there are issues coming as i am not able get a 200 response from my private api. I am send json data to my api. Please help/
1
InfoQuest Solutions's profile photoTravis Reeder's profile photo
7 comments
 
Different use cases. Push queues are typically so you can push to yourself and do some "work" in your application rather than as an IronWorker. Or if the endpoint can accept the push queue message, then it's easier than building a worker for it. 

That said, we do plan to support custom headers for push queues at some point. 
Add a comment...

Created by

Kapil Sachdeva

IronWorker  - 
 
Multi-tenant & secure solution using firebase and ironworker
How to use open technology stacks and a set of cloud services & platforms (that provide free tier) to create a multi-tenant, real time, secure and scalable solution. We would use Firebase, IronWorker and Ionicframework to build the solution
2
Add a comment...
 
Hi all,

I searched a lot but couldn't found any description on properties of responses that are being sent by REST API (http://dev.iron.io/mq/reference/api/#responses) Almost all properties of responses are self explanatory but some properties needs to be described. Let me mention some of them;

In response of GET /projects/{Project ID}/queues/{Queue Name}/messages/{Message ID}/subscribers request, what is property ID? (this is not message ID as I have checked it. In case of uni-cast push queue it is the same number as message_id+1)
In response of GET /projects/{Project ID}/queues/{Queue Name}/messages/{Message ID} request, what is property reserved_count?

In response of GET /projects/{Project ID}/queues/{Queue Name} request, what is property size? (It looks to be queue size from its value but again what is queue size? Queue Size on my Dashboard always displays zero)

As per my understanding if a message is retrying 2nd or 3rd time its retries_remaining should be equal to retries_total - number of retries attempts. But this is not case. Every time I have seen that retries_remaining is not changing. What are the cases in which retries_remaining will change?

After the message is tried "retries_total" number of times, message "status" should be changed to "error" but it remains "retrying"
Is there any log of message routing? means, if a message is first send to subscriber 1 but not received 200 in response. The same message will be then send to other subscriber say subscriber 2. 


Regards,
1
Add a comment...

Braxton Beyer

IronWorker  - 
 
how do I require a file from a subdirectory in my worker and have it live in the same subdirectory when built?
1
Chad Arimura's profile photo
 
Check out the "file" keyword in the following doc:  http://dev.iron.io/worker/reference/dotworker/#syntax_reference 

You can use file in your .worker file like this:

file source, destination

file 'my_dir/my_file', 'my_dir/my_file'

Should work but maybe +Stephen Nguyen can double check.
Add a comment...
 
I can't find any documentation on this, but can I assume its possible to use IronMQ as a payload delivery mechanism for IronWorkers?
i.e have the workers fire up every 60 seconds and see if there are any jobs in the queue, then shutdown if not?
Thanks,
1
Joseph Szobody's profile photoTravis Reeder's profile photo
6 comments
 
Hey guys, Steven, the scheduled way is a good way to do it. Also, our alerts feature is a great way to auto scale workers based on how big your queue is getting: http://dev.iron.io/mq/reference/queue_alerts/

To use alerts, you'd basically set up this configuration:

- make a push queue with an ironworker:// subscriber.
- set alerts on your main queue with a target to the push queue (from line above)

This will basically fire up an IronWorker whenever an alert is triggered. 
Add a comment...

Abubaker Bilal

IronWorker  - 
 
I have uploaded a worker and ran it successfully, and my worker actually writes data into a file. How can I get/download that file?

Regards
Abubakar
1
Chad Arimura's profile photoAbubaker Bilal's profile photo
2 comments
 
Thanks alot, but when I try to put something in cache, I get this error:

"\xAE" from ASCII-8BIT to UTF-8 (Encoding::UndefinedConversionError)

Thanks for your help
Add a comment...
 
Just upgraded my #camel component for IronMQ https://github.com/pax95/camel-ironmq to the latest Camel and IronMQ java version. 
camel-ironmq - camel ironmq component
1
Add a comment...
 
bugs/undocumented behaviour with beanstalk interface:

1, unable to "watch" any queue if the name includes "_". sample(copy & pasted from telnet):
put 0 0 0 58
oauth {token} {project_id}
INSERTED 0
watch abc_test
BAD_FORMAT

2, the watch command replies wrong watching count. sample:
put 0 0 0 58
oauth {token} {project_id}
INSERTED 0
watch abc
WATCHING 2

one more question:

is it possible to have impose access restrictions by token? e.g. a token that can only watch, reserve and delete jobs, not able to put jobs?
1
Linan Wang's profile photoEvan Shaw's profile photo
8 comments
 
Yes, there is a possible performance implication in watching an unused channel. It does not count as an extra API call, but it does cause the server to do a little more work, I don't know how measurable the difference would be.
Add a comment...

Travis Reeder
moderator

General  - 
 
New node scheduling package using Iron.io:

The Iron Scheduler is an ironio worker that queues configured tasks. It's the master in the master/slave setup that ironio recommends.
Iron Scheduler can be used as an independent worker, or you can use it programatically.
Schedule and queue ironio worker tasks.
1
Add a comment...

Travis Reeder
moderator

IronMQ  - 
 
Camel component for IronMQ. 
1
Add a comment...