1 of 3
1
Offload, Security and Scalibility TRAFFIC via S3
Posted: 29 April 2007 12:22 PM   [ Ignore ]  
Summer Student
Total Posts:  28
Joined  10-15-2003

I am actively looking for an ftp server that will be controlled through ExpressionEngine.

The must haves are:
- user management
- individual drop folders
- access restrictions
- account history
- upload and download triggers
- web file management


They are using sftpd at the moment.
Any thought or suggestions would be greatly appreciated.

Cheers,
LinesDrawn

I changed the title to better reflect where this thread headed.

Profile
 
 
Posted: 29 April 2007 08:44 PM   [ Ignore ]   [ # 1 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  507
Joined  04-23-2006

The lack of replies could be because of the wording in what you are asking.

Are you looking for an FTP application? Are you seeking some functionality in EE to FTP?
I’m sort of lost on what you are asking LinesDrawn.

 Signature 

OLD username was jammo, NEW username is OrganizedFellow

It’s a struggle even to keep focused. This is the best of my AD/HD & GTD.
The exceptionally slow growth of my web dev projects is eclipsed by my patience, understanding and desire to learn AS MUCH AS POSSIBLE as I slowly progress.

Profile
 
 
Posted: 30 April 2007 01:21 AM   [ Ignore ]   [ # 2 ]  
Research Scientist
Avatar
RankRankRankRankRankRank
Total Posts:  5891
Joined  11-23-2003

You will need a custom built solution for sure.  I would suggest checking into the Amazon S3 service which was pretty much built for this type of purpose.  The S3 resources area even has PHP libraries which can be used as a starting point.  You can store all your files cheap and you don’t have to mess with the file system on your own server.

 Signature 

EE 2.0:  A designers dream becomes a developers dream | Follow me on Twitter.

Profile
 
 
Posted: 30 April 2007 08:26 AM   [ Ignore ]   [ # 3 ]  
Summer Student
Total Posts:  28
Joined  10-15-2003

Thank you jammo for moving the post, I agree that my description was lacking.

John Fuller seems to be clairvoyant, Amazon simple storage services looks like the solution.
Thank You Mr Fuller:)

If any one would like a progress report let me know, I will be working on a module for EE

Cheers,

Profile
 
 
Posted: 08 May 2007 08:13 AM   [ Ignore ]   [ # 4 ]  
Grad Student
Rank
Total Posts:  40
Joined  04-06-2007

I’d love a progress report.  Put up a post when you get something useable.  Or, you know, if you need help getting something useable, hehe.

Profile
 
 
Posted: 08 May 2007 09:10 AM   [ Ignore ]   [ # 5 ]  
Administrator
Avatar
RankRankRankRankRank
Total Posts:  2552
Joined  05-17-2002

You’re creating an EE add-on that integrates Amazon’s S3 service? That does sound interesting. How’s that going?

 Signature 
Profile
MSG
 
 
Posted: 09 May 2007 08:12 PM   [ Ignore ]   [ # 6 ]  
Summer Student
Total Posts:  28
Joined  10-15-2003

Hello Thorvald and Leslie Camacho,

Progress is going quite well considering the amount of time I had to work on it, I have been reassigned to D E L T E K V I S I O N customization which is a sad program.

Below is what I have found so far in no real order:
Luckily A3 uses easily addressable buckets, get the S3 explorer.
I have it set up so every weblog/section in EE gets assigned a unique bucket. In EE this is like creating a new upload destination. The real nice thing is this bucket is now defined so the only thing the user needs to do is upload, no destination directory required. I have found that users always default to the first one anyway.

A3 has no file/folder structure so you will have to keep track of what you create, I am using an xml file.

Look for a more detailed progress report to follow.

Cheers,

Profile
 
 
Posted: 12 July 2007 11:21 PM   [ Ignore ]   [ # 7 ]  
Lab Technician
Avatar
RankRankRankRank
Total Posts:  1590
Joined  01-05-2007

This sounds very interesting indeed! I would be very interested in getting a progress report too smile

 Signature 

 
Steven Hambleton | ExpressionEngine Development for Web & Graphic Design Agencies

Profile
 
 
Posted: 13 July 2007 07:34 AM   [ Ignore ]   [ # 8 ]  
Summer Student
Total Posts:  28
Joined  10-15-2003

A3 Knowledge
Head on over and read IBM’s article Offload your multimedia content and bandwidth to Amazon using PHP
Do notice the warning of requiring unique bucket names, in my haste I tested with what I thought was a unique name and oh the hours I wasted.

I have it working but no clean EE add on yet, I am working on the code every-chance I get but I did a real hack job in the learning phase that then had to go prime time because they needed it now.

For you podcasters, large file distributors or any one else requiring scalability like the big boys S3 is a must look at service.
The s3.classes are empowering and dare I say it EE like.

Thorvald and stinhambo I can release what I have so far if you want please PM me.
I really would go through the IBM how to first, I wish I had this when I started.

Worth your time:
Rjonna’s excellent firefox plugin for S3

Cheers,
LinesDrawn

Profile
 
 
Posted: 21 November 2007 10:17 PM   [ Ignore ]   [ # 9 ]  
Grad Student
Rank
Total Posts:  42
Joined  03-21-2007

I’m researching, and shortly will be writing specs for a similar if not identical plugin.

For us there are two key goals, firstly to make the upload process a little more user friendly, that started life a separate project. But when I came across Amazon S3, it seemed to make perfect sense to marry the two.

Currently investigating the best way to implement this, as one of the key requirements for us will be having a progress bar for the uploads etc.

Interested to know if you have got any further, and any problems you have faced.

Profile
 
 
Posted: 15 December 2007 11:10 PM   [ Ignore ]   [ # 10 ]  
Summer Student
Total Posts:  28
Joined  10-15-2003

Hello neekster,

Sorry it took me so long in getting back to you.

I have had very little interest in EES3, in fact you are the only one who has inquired about it.
For what it is worth, it took less than a dozen methods to get it working. Integrating it with EE the way the client wanted was a pain that I thought would never end. I never got around to doing a clean integration with EE though.

You want your user to have confirmation of progress:) I added a java one that worked like a charm.

Perhaps I should resurrect EES3?

Cheers,

Profile
 
 
Posted: 17 December 2007 03:59 AM   [ Ignore ]   [ # 11 ]  
Grad Student
Rank
Total Posts:  42
Joined  03-21-2007

Thanks LinesDrawn,

I’m a little behind in putting together specifications for this one, although I’m still very committed in getting something out the door in the new year. I was hoping for a little more interest here that would have inspired me to move on it a little quicker.

I remain convinced though that it would simply be an amazing addition to EE. Perhaps the lack of interest here is due to a not so widespread knowledge of S3 and it’s capabilities?

Profile
 
 
Posted: 17 December 2007 04:40 AM   [ Ignore ]   [ # 12 ]  
Summer Student
Total Posts:  6
Joined  07-28-2004

I hope you continue with your work neekster, I think it would be amazing to have this scalability in an EE based media site for example. It would solve a big hurdle for me and enable me to do what I want so I for one applaud you on your work.

Profile
 
 
Posted: 17 December 2007 10:31 AM   [ Ignore ]   [ # 13 ]  
Summer Student
Total Posts:  28
Joined  10-15-2003

Hello neekster and patueb,

If you like I could put up an EES3 retrospectiva so we could combine efforts on getting this out to the community.

Let me know.

Cheers,

Profile
 
 
Posted: 17 December 2007 10:48 AM   [ Ignore ]   [ # 14 ]  
Grad Student
Rank
Total Posts:  42
Joined  03-21-2007

Sounds good to me, I will start getting my head into this project again over the next few days. I’m really keen to get something happening on this one smile

Profile
 
 
Posted: 17 December 2007 12:12 PM   [ Ignore ]   [ # 15 ]  
Lab Assistant
Avatar
RankRank
Total Posts:  174
Joined  03-31-2002

I second patueb - I already use S3, and would love to see EE integration.

Les

 Signature 

Les McKeown, President & CEO
Predictable Success®

Profile
 
 
Posted: 17 December 2007 02:23 PM   [ Ignore ]   [ # 16 ]  
Summer Student
Total Posts:  28
Joined  10-15-2003

EES3 now has project management and bug tracking up at retro.linesdrawn.com

Should others want to chime in please feel free to request a login.


Cheers,

Profile
 
 
Posted: 25 December 2007 02:57 PM   [ Ignore ]   [ # 17 ]  
Grad Student
Rank
Total Posts:  74
Joined  11-01-2006

This is just to voice my interest in having an EE S3 plugin. I’m starting a project in the new year for which S3 would be perfect, and I’d love to give the client some way to use S3 through the EE CP. Thanks to all for your work so far…

Profile
 
 
Posted: 29 December 2007 04:24 AM   [ Ignore ]   [ # 18 ]  
Summer Student
Avatar
Total Posts:  23
Joined  01-04-2006

I am very interested to see how this upcoming plugin could work with S3.

Keep up the good work!

Profile
 
 
   
1 of 3
1
 
Post Marker Legend
New Topic New posts Hot Topic Hot Topic with new posts New Poll New Poll Moved Topic Moved Topic Sticky Topic Sticky topic
Old Topic No new posts Hot Old Topic Hot Topic with no new posts Old Poll Old Poll Closed Topic Closed Topic Announcement Announcements
Theme
Change Theme
Visitor Statistics
The most visitors ever was 1149, on July 16, 2007 09:33 AM
Total Registered Members: 64914 Total Logged-in Users: 16
Total Topics: 81868 Total Anonymous Users: 21
Total Replies: 440130 Total Guests: 161
Total Posts: 521998    
Members ( View Memberlist )
Newest Members:  smilepolitelyrvmcleodbjmohrAqua193Bios Elementmjpoteetguimogranwelshmrcfthenetmonkey
Active Members:    3000CarlocbridgewCrucialCyan DesignEveretthotknifeIngmar Greiljames BrownJohnDjtnewsLLeakeP.J.Robb Ottenhoffrvmcleodsakana