Profile

Cover photo
Nick Craig-Wood
Works at Memset Ltd
Attended Emmanuel College, Cambridge
Lives in Guildford
75 followers|256,909 views
AboutPostsPhotosYouTube+1's

Stream

Nick Craig-Wood

Discussion  - 
 
Error 401: Invalid Credentials, authError on long uploads

One of my users keeps getting this while trying to upload big .zip files (of about 0.5-2 GB in size).  The transfers run for 40 minutes or so then fail with the error above. I'm doing the transfers with a single insert.

Some of the transfers have succeeded so I know that it is possible to transfer 2 GB .zip files like this.

Has anyone else seen this problem?  Got a work-around?

Thanks
1
Roy Smith's profile photoZhirayr Cedrakyan's profile photoNick Craig-Wood's profile photoAngelo Pengue's profile photo
5 comments
 
+Nick Craig-Wood yeah the resumable transfer method is the right way to go for large files (and arguably files of any size)
Add a comment...

Nick Craig-Wood

Discussion  - 
 
I keep getting "Error 403: User rate limit exceeded, userRateLimitExceeded" from my app (http://rclone.org) .

My Google Developer Console says each user can have 1000 queries/second, but even if I limit rclone to 4 queries per second I get these 403 errors!

Does anyone know what the limits are for Google Drive? Or is it necessary to implement exponential backoff on 403 rate limit errors?

rclone does multiple transfers at once which might confuse drive's lmiting code.

Anyone have any ideas?

Thanks
1
Nick Craig-Wood's profile photoRoy Smith's profile photo
6 comments
 
NP. It would be great if Drive knew how to distinguish legitimate apps from DOS attacks.

How about an API call addTokensToBucket(1000) so we could negotiate flow control in advance?
Add a comment...
 
Go 1.4 released!  You can now try https://github.com/ncw/gotemplate - my take on the simplest possible templating system for Go with go generate. #golang
gotemplate - Package based templating system for Go
1
Add a comment...

Nick Craig-Wood

Shared publicly  - 
 
Finally releasing rclone - rsync for object storage.

Rclone is a command line program to sync files and directories to and from

  * Google Drive
  * Amazon S3
  * Openstack Swift / Rackspace cloud files / Memset Memstore
  * The local filesystem

Features

  * MD5SUMs checked at all times for file integrity
  * Timestamps preserved on files
  * Partial syncs supported on a whole file basis
  * Copy mode to just copy new/changed files
  * Sync mode to make a directory identical
  * Check mode to check all MD5SUMs
  * Can sync to and from network, eg two different Drive accounts

Links

  * http://rclone.org/ - main website
  * http://github.com/ncw/rclone - code/bugs
  * https://google.com/+RcloneOrg - G+
2
2
Juan J. Martínez's profile photoslamet hendry's profile photo
Add a comment...

Nick Craig-Wood

Discussion  - 
 
In the Files insert API it states "modifiedDate ... This is only mutable on update when the setModifiedDate parameter is set", however there isn't a setModifiedDate parameter documented.

I'm using the Go API and it doesn't have a SetModifiedDate parameter either.

So is this a documentation bug? Or does it really exist?
2
David French's profile photoNick Craig-Wood's profile photo
2 comments
 
+David French Ah so do you think the 'on update' bit refers to the update method?  If so then this is a misplaced comment.  Setting modified date on insert seems to work so I think the comment is a mistake.
Add a comment...

Nick Craig-Wood

Discussion  - 
 
Happy #PiDay! Wondering how it's calculated? Check out my Pi in Python series which gets up to 100 million digits!  It starts easy with Gregory's Series, moves through Archimedes and Machin and arrives at Chudnovsky where it calculates 100 million digits in 10 minutes.
4
1
Nick Craig-Wood's profile photo
Add a comment...

Nick Craig-Wood

Show and tell  - 
 
Industrial strength drop in replacement for math/big using GMP.  Youcan just change the import and enjoy the super speed of GMP in your go programs.
15
Add a comment...
Have him in circles
75 people
Thomas Witherspoon's profile photo
Rakib Mahmud Jimmy's profile photo
Liam Devaney's profile photo
Thomas Wilde's profile photo
Peter Bowles's profile photo
Henrik Jensen's profile photo
Ross Martyn's profile photo
Rick Morrison's profile photo
Bony Jose's profile photo

Communities

9 communities

Nick Craig-Wood

Shared publicly  - 
 
My morning walk with #nexus6 and HDR+
1
Add a comment...

Nick Craig-Wood

Announcements  - 
 
I'm looking for testers, users and developers for rclone the somewhat ambitiously subtitled "rsync for object storage" including Google Drive.

Rclone is a command line program to sync files and directories to and from

  * Google Drive
  * Amazon S3
  * Openstack Swift / Rackspace cloud files / Memset Memstore
  * The local filesystem

Features

  * MD5SUMs checked at all times for file integrity
  * Timestamps preserved on files
  * Partial syncs supported on a whole file basis
  * Copy mode to just copy new/changed files
  * Sync mode to make a directory identical
  * Check mode to check all MD5SUMs
  * Can sync to and from network, eg two different Drive accounts

Links

  * http://rclone.org/ - main website
  * http://github.com/ncw/rclone - code/bugs
  * https://google.com/+RcloneOrg - G+
3
Add a comment...

Nick Craig-Wood

Shared publicly  - 
 
 
Happy #PiDay! Wondering how it's calculated? Check out my Pi in Python series which gets up to 100 million digits!  It starts easy with Gregory's Series, moves through Archimedes and Machin and arrives at Chudnovsky where it calculates 100 million digits in 10 minutes.
1
Add a comment...

Nick Craig-Wood

Discussion  - 
 
 
Happy #PiDay! Wondering how it's calculated? Check out my Pi in Python series which gets up to 100 million digits!  It starts easy with Gregory's Series, moves through Archimedes and Machin and arrives at Chudnovsky where it calculates 100 million digits in 10 minutes.
3
Add a comment...

Nick Craig-Wood

Show and tell  - 
 
Just for fun - a channel based quicksort.

Interesting that you can make a quicksort without being able to index your input.  It may be O(n log n) for comparisons but it is O(n) for channels and go routines so perhaps not the most efficient quicksort ever ;-)

It also has the worst case complexity O(n²) if you feed it sorted input, so don't do that!
16
1
Samuel Falvo II's profile photoNick Craig-Wood's profile photoThiago Avelino's profile photo
2 comments
 
+Samuel Falvo II  There is certainly a merge sort element to the above...
Add a comment...
People
Have him in circles
75 people
Thomas Witherspoon's profile photo
Rakib Mahmud Jimmy's profile photo
Liam Devaney's profile photo
Thomas Wilde's profile photo
Peter Bowles's profile photo
Henrik Jensen's profile photo
Ross Martyn's profile photo
Rick Morrison's profile photo
Bony Jose's profile photo
Communities
9 communities
Education
  • Emmanuel College, Cambridge
    Physics, 1986 - 1989
Basic Information
Gender
Male
Relationship
Married
Story
Introduction
Memset Dedicated Hosting Technical Director, Maths, Science and Computing Geek.
Work
Occupation
Technical Director
Employment
  • Memset Ltd
    Technical Director, 2003 - present
Places
Map of the places this user has livedMap of the places this user has livedMap of the places this user has lived
Currently
Guildford
Nick Craig-Wood's +1's are the things they like, agree with, or want to recommend.
ElephantPi
market.android.com

ElephantPi is a tool to help you memorize digits of Pi. The two main things you can do are:- Learn: View and/or listen to digits in order to

rclone - rsync for object storage -
rclone.org

Rclone. Logo. Rclone is a command line program to sync files and directories to and from. Google Drive; Amazon S3; Openstack Swift / Rackspa

Minecraft Xbox - Googlie Goods [112]
www.youtube.com

Part 113 - http://youtu.be/C4dS5DOHAX0 Welcome to my Let's Play of the Xbox 360 Edition of Minecraft. These videos will showcase what I have

Minecraft Xbox - Pick A Pet [111]
www.youtube.com

Part 112 - http://youtu.be/BWyWha18eU4 Welcome to my Let's Play of the Xbox 360 Edition of Minecraft. These videos will showcase what I have

SwiftKey 3 Keyboard
market.android.com

Unlock your typing potential. * Webby Awards People’s Voice Winner for Innovation, 2012 * * Mobile World Congress Award Winner for Innovatio

What's My DNS? Global DNS Propagation Checker
www.whatsmydns.net

What's my DNS? Instantly check your hostnames current IP Address and other DNS information against a selection of random name servers around

Requests: HTTP for Humans — Requests 0.8.3 documentation
docs.python-requests.org

Requests: HTTP for Humans¶. Release v0.8.3. (Installation). Requests is an ISC Licensed HTTP library, written in Python, for human beings. P

DoggCatcher Podcast Player
market.android.com

Find, manage, and play your podcasts with DoggCatcher Manage your podcasts and RSS/news feeds with the first Podcatcher in the Market. Highl

Osmos HD - Apps on Android Market
market.android.com

Absorb, or be absorbed... The hit iOS game comes to Android! Enter the Darwinian world of a galactic mote. To survive, absorb smaller organi

geoipdns
geoipdns.org

A location aware DNS server useful for CDNs, location specific content and other location based services.

Knuth’s Wisdom
nicknash.me

Or, what’s really so bad about bubble sort? Prologue In a previous post I talked about trying to bring out the worst in sorting algorithms.

IOCCC 2012 Mersenne Prime Checker
www.craig-wood.com

#include #include #include #include #define H uint32_t #define U uint64_t #define N void #define T int #define P calloc(n,sizeof(U)) #define

Oxo 3D - Android Market
market.android.com

Explode your brain with 3D tic-tac-toe / noughts-and-crosses. It's a challenge! Oxo 3D is a 3 dimensional (4x4x4) noughts-and-crosses / tic

Meandering Through Mathematics: Numerical Analysis: How to Calculate Spe...
meandering-through-mathematics.blogspot.com

Your calculator has buttons for all sorts of special functions, like square root, sine, cosine, and logarithms. How does the calculator know

20+ Things to Do with a Hundred Chart
letsplaymath.net

[Photo by geishaboy500.] Are you looking for creative ways to help your children study math? Even without a workbook or teacher's manua

Is there another GCHQ Code Challenge? | John Graham-Cumming
blog.jgc.org

Is there another GCHQ Code Challenge? Update: The answer is Yes, sort of. Last week GCHQ issued a 'code challenge' as a way of attra

How I Solved the GCHQ challenge
www.craig-wood.com

Categories: maths, python | View Comments. This is an unsanitised account of how I solved the GCHQ challenge at http://www.canyoucrackit.co.

Boot Multiple ISO from USB via Grub2 using Linux | USB Pen Drive Linux
www.pendrivelinux.com

Boot Multiple ISO from USB via Grub2 using Linux. Boot ISO Files directly from USB using Grub2 from Linux. Here is one way to create a Multi

GitHub in Numbers — Светлячный Dev Лог
dev.svetlyak.ru

GitHub in Numbers. Tags: git, github. ru. Some times ago, I had got an idea — to create a new service around the GitHub. In the first place