Tuesday, March 31, 2009

Response to a blog comment

My previous blog post received the following comment:

Why offer a service that can't meet the demands? Just curious.

Here is my answer:

I had another paragraph in the post and decided to omit it but perhaps I should have kept it, it may have answered this question before it was asked. Simply put, this service was established as my way of tracking my own followers which I figured I would share with other people once it came to mind. The entire process of establishing the service went from a Saturday afternoon when the idea came to me to launching it 5 days later on a Wednesday morning. That isn't to say I won't do what I can to accommodate those using it and those who want to use it, but the website is more a personal project of mine than a business. Twitter could (but likely won't) defeat the purpose of this app with a single change in which you get a notice when somebody stops following you the same way you get a notice when they start.

Outside of these facts, the limitation to meeting demands is no fault of my own. The service itself does not create a heavy load on the computer that runs it. The limitation to meeting demand is on the side of Twitter's API, which this service is built upon. Enhancements to Twitter's API would open up the service to a larger capacity of people, but as it stands, the level is many times smaller.

Where's my invite?

Common question I receive by @reply (or rather by mentions now) and Direct Message is, "When will I receive my invite?"

The short and quick answer is I do not know.

The number of users the application can sustain with its current format is still questionable. It's not the number of users but the number of changes that those users followship undergoes. Very popular users are more likely to inhibit the service than people who undergo follow changes in the single digits. The frequency those popular users get their updates is also a factor. Whether popular users will have to be enforced with the policy of getting their updates more frequently so as to distribute their effect on the app's hourly twitter access is debatable. How that can be done in an automated way is another question.

Another question is, given the state of twitter's API, will it come to a point where some users will have to be given certain days of the week they can get stats so as to allow for more users to use the service? These are all questions that need to be answered before all the people in the queue can be given access to the service.

Friday, March 27, 2009

Latest Information

First, I just want to give acknowledgement to the wonderful people at FHOKE. They are a creative digital agency using the service. They offered, and I gladly accepted, to redesign the follow watch website. So the site has a new layout. The original layout I designed really was meant to be a temporary thing, and FHOKE really came through.

Now on to bugs, updates, invites, and some stats.

Past couple of days some people have been getting empty reports, or reports with empty names.
Example: Lost: ,,,@twitterperson,,@person2,

This is caused by twitter returning an empty name value when the reports get generated. This usually doesn't happen, and most names are properly reported, but the same way twitter the site's been acting up, twitter the API, where FollowWatch gets its data from, is also acting up. An update will be made to remove those listings from your report.

An update will also be made to keep your avatar up-to-date. Currently the one you had when you registered is stored and shown with your updates. This works fine except for users who change their picture. These updates may get posted Saturday.

In other news, the queue of users waiting to sign up has currently reached over 700 people. The app is at about 850 users, so I will probably be sending out about 150 invites. These invites will be automatically sent to people in the order they got on the queue. Once the app reaches 1000 users, it may be at least a week before more people get invited. I have to make sure it can sustain the number of users. Some higher end users may get forced into more frequent updates, or may have to move some users to different time slots.

Current Distribution of Report Generation
12am - 519 reports to generate
1am - 63 reports to generate
2am - 71 reports to generate
3am - 262 reports to generate
4am - 79 reports to generate
5am - 56 reports to generate
6am - 83 reports to generate
7am - 61 reports to generate
8am - 94 reports to generate
9am - 82 reports to generate
10am - 91 reports to generate
11am - 64 reports to generate
12am - 175 reports to generate
1pm - 72 reports to generate
2pm - 87 reports to generate
3pm - 83 reports to generate
4pm - 94 reports to generate
5pm - 78 reports to generate
6pm - 113 reports to generate
7pm - 75 reports to generate
8pm - 104 reports to generate
9pm - 98 reports to generate
10pm - 98 reports to generate
11pm - 72 reports to generate

All times US Eastern

Sunday I will be offline @ the ShowBiz Expo in New York City. You can follow the Expo on twitter http://twitter.com/theshowbizexpo.

Wednesday, March 25, 2009

Updates

Ran out of the first 1,000 invites, not everyone used one. Been inviting some people manually (people who wrote @followwatch for an invite and people who DM'd about an invite). Currently at time of writing, tracking stats for 815 twitter users who have over 350,000 followers combined. Updated some stuff on the website earlier today so people understand each of the checkboxes on the sign up page and settings page. Updated some things in the database to support users who have massive added and dropped friends between reports. One user had well over 400 add/removes between reports that failed to get the report stored. The update should fix that.

Once I'm at 1000 users I'm going to hold off on sending invites out until I can make sure the site can sustain the amount of users & their gained/lost followers from a standpoint of Twitter's API limitations.

If you are a current user of the service and only get updated once an hour, please go to the settings page and select at least one more hour. The more frequent reports are updated, the more people the service can support.

Monday, March 23, 2009

The Process

If this isn't the first site that tracks your un-followers, you may have heard of useqwitter.com. I didn't actually hear about this service until I was 2 days into my development of this service. That site does not require your password, it asks for your username and your e-mail address and it sends you an e-mail when someone unfollows you. At least that's how it's supposed to work. While I decided to continue on with my development of this site, I did sign up with useqwitter. I have not yet received a single e-mail.

This is caused by limited resources. In order to maximize the number of users who can use this service, the number of followers it can track, it leverages some of the twitter data access through your account. Looking up your followers is done through your account. By operating this way, it maximizes the amount of people who can subscribe to this service.

Additionally, at any point you feel like you are dissatisfied or you feel uncomfortable with the site having your data, you can delete it from the system. The last thing I want to do is make anyone feel uncomfortable about sharing this information.

Ultimately I will say this, if you don't trust the app, don't use it. No harm, no bad feelings :)

Friday, March 20, 2009

Repeated Names

With the site on its current schedule of daily reports, you may see names in both columns of your report if the person added you and removed you in the same day. The spam_or_APIfail listings appear to definitely be spam accounts caught by Twitter.

This weekend's updates will include excluding these items from your report data.

Wednesday, March 18, 2009

Updates

Day one was relatively successful. There were a few bugs found here and there, but they were quickly caught and resolved. One user was removed by request until a feature was added, and two suggestions were made, which lead to another feature request.

The first request was that tweeting your stats to your page be optional. I made a false assumption that people didn't mind this information being made public to their followers. Relatively easy to add in. Probably add in this weekend.

The second request was that the status updates came less frequently, perhaps daily or semi-daily. This has already been changed. Your followers are still processed on an hourly basis, but your report is only updated daily. It's been suggested to allow users to pick which hours of the day the daily reports are processed. This requires a little more effort to change and will probably get added in this weekend as well. Until then, reports are generated for every user once daily at Midnight Pacific Time.

Feedback is always encouraged and any thoughts on these changes or features should be commented.

Real Time Polling

A user, @Meezyy, suggests real time polling. It is a nice idea but there's a few hurdles to deal with on this.

The first is not to bog down Twitter with requests. Most people have noticed the past couple of days twitter's been dealing with issues, delayed tweets, delayed direct messages, things appearing sometimes and then disappearing to reappear again later.

The second is not to debilitate our service or your usage of other apps. If you use a client like TwitterBerry, TwitterFon, TwitDroid, etc, you are using API calls. TweetDeck keeps you informed about these. Every account is given 100 API calls per 60 minute timeframe. You use an API call every time you check @replies, direct messages, your personal timeline (twitter.com/yourname), your friends timeline (twitter.com/home), etc. using anything but the twitter.com website. Updating your status doesn't count against this limit. After you use those 100, you're locked out until the time resets. TweetDeck columns won't get refreshed, checking friends/@replies/dms from twitterfon/twitterberry/twitdroid/etc. won't get any new tweets.

FollowWatch polls your followers list once an hour from your account (using 1 of your API calls). It's the reason behind getting your password. Retrieving username info for each of the people that have changed on your friend's list is retrieved through our account. FollowWatch is allowed 20000 calls per 60 minute timeframe as a developer account. While it probably could update in real time by polling more frequently, it wouldn't be able to provide stats for that many people.

Still, if a way existed, it's a feature worth looking into.

FollowWatch Blog

From a concept Saturday afternoon to a launched website Wednesday. It has been a fun process figuring out how exactly I wanted this service to work. For now we are in invite only phase. I have no idea what kind of viral effect may occur when the service actually launches, so 1000 people is the current limit. At the time of this writing I still have some things to finish up before I twitter this link to the friends on my personal twitter. If you're reading this though, it is noted that the site's been launched. Suggestions on how to improve the service may be left on this blog, or tweeted to @followwatch.

For those that do not know me, my name is Pierre Fontenelle. I developed and ran a website called CrushSpot for 3 years until I made a deal with another company.

So as noted, feel free to leave your suggestions on this blog. I will probably write on any updates made to the service on this blog.