Computing appliances — architected for network stream processing
I’ve been researching computing appliances quite a lot recently, including for an upcoming trade press column. As part of the research, I circulated preliminary thoughts and questions to a variety of appliance vendors. One, Barracuda Networks, responded at length via e-mail. Credit goes to Steve Pao, VP of Product Management. I’m posting the interchange below.
Q1. Stream processing is different from conventional business computing. Different hardware architectures are commonly appropriate.
A1. Stream processing is different, particularly for enterprise networks, because data in the stream should not back up during processing to create latency. In traditional business computing, total throughput is measured more often than latency. Minimizing latency requires careful attention to layering processing to handle as much as possible with the least expensive operations first, keeping the footprint as small as possible to minimize any virtual memory swapping, and minimizing I/O. There are some hardware considerations, but this is often over-emphasized. As applications delivered through appliances continue to grow in complexity, software architecture plays an often under-represented role.
Barracuda Networks has designed the architecture of its appliances with these characteristics in mind. For example, the Barracuda Spam Firewall’s architecture leverages 12 defense layers, focusing on those layers that require the least processing upfront. This layered approach minimizes the processing of each spam message, which yields the performance required to process email for tens of thousands of users in a single appliance.
CAM note: This kind of “it’s the software, stupid” response is typical of what I hear from appliance vendors.
Q2. For most kinds of appliances, custom chips are nice-to-have but not must-have. And by the way, if there are “custom” chips, they will usually actually be FPGAs.
A2. Custom chips are useful for very high volume/low cost appliances because they can help reduce cost of goods. That said, for most enterprise-class networking and network security appliances, off-the-shelf chips generally provide the performance and flexibility to deliver performance for today’s networks.
Q2A (followup): Looking into this further, I’m getting the sense that boxes are custom but components are not. That is, appliances with a stream-processing flavor commonly include networking cards that, while standards, aren’t common in general-purpose computers. Encryption also is commonly handled by specialized chips.
A2A. Yes, delivery of appliances often requires use of components that, while standard, are not typically used in general purpose computers. Even beyond hardware that vendors may use to enhance system performance, there are also hardware components that are included for the reliability requirements of networking appliances.
For example, the Barracuda Web Filter and Barracuda IM Firewall are network appliances designed to be deployed inline. On the Barracuda Web Filter models 310 and higher and the Barracuda IM Firewall models 320 and higher, the appliances include an Ethernet hard bypass that fails “safe” – allowing traffic to flow through – in the event of system failure.
As another example, the Barracuda Load Balancer is diskless and boots from high capacity flash memory.
Q3. Deliberately limiting the capability of the system makes it harder to hack. But this is important only in security appliances, and I’m not so sure it’s important even for them.
CAM note: The answer below confirms what I said, but with more accurate phrasing.
A3. It is common practice to minimize the number of traditional operating services in order to reduce the potential for vulnerabilities in the system. Every component that is used has the potential to open another vulnerability. That said, today’s applications require a level of sophistication that also requires more underlying services than ever before. As such, the important thing is to have a great internal development process for system design and maintaining a great relationship with the “white hat” security research community. Of course, while larger vendors are larger targets for exploits, they also have the advantage of having the notoriety to attract top security researchers to work with.
Q4. A huge part of appliances’ appeal is ease of deployment and administration. Applications used to arrive bundled with hardware very commonly, especially for smaller buyers (and for them it’s often true even today). Appliances offer the same benefit for system software.
A4. We agree with this assessment. Customers usually can get a Barracuda Networks appliance completely deployed in less time than it takes to load an OS onto a hardware platform – let alone install or configure software applications.
Q5. There’s a lot of grumbling about appliance maintenance costs, as appliance vendors charge percentage-of-purchase-price fees that would be appropriate for packaged software and apply them to the whole bundled hardware/software appliance.
A5. Interestingly, the appliance vendor often has to do more than a traditional software or hardware vendor. There’s a set of support issues that a traditional software vendor can simply sidestep because they don’t support the OS on the hardware. A hardware vendor can generally wash themselves of all issues not related to hardware. What the customer gains from support from a good appliance vendor is a complete solution and no finger pointing. All that said, if the appliance is overpriced, the customer may not get a good value. Customer should always look at the value and absolute dollars as opposed to percentages.
Barracuda Networks does not charge on a per-user basis. Customers pay a one-time fee for the appliance and a recurring yearly fee for Barracuda Energize Updates which include not only basic technical support and firmware updates but also, depending on the product, ongoing virus, spam definition, spyware definition, content filter, IM protocol, and intrusion prevention definitions. For a low annual fee, Barracuda Networks’ customers can deploy secure solutions with virtually no ongoing administration. Energize Update pricing is based on model number and starts at $499 per year.
Optionally, customers can also purchase an Instant Replacement service. In the event of hardware failure, Barracuda Networks products with active Instant Replacement subscriptions can be cross-shipped the next business day to minimize downtime. Instant Replacement pricing is also based on model and starts at $499 per year.
| Categories: Barracuda, Computing appliances, Security and anti-spam | 2 Comments |
Anonymizer – penetrating the Great Firewalls of China and Iran
Lance Cottrell of Anonymizer is one of those rare guys who make me believe he started a company in no small part to do good. And so his cloaking-technology company is providing free services to help Chinese citizens sneak through their national firewall, and is doing the same thing for Iran on a paid basis, under contract to the Voice of America. I think this is wonderful, and he reports that it’s working well now. Even so, I think there are scalability concerns. Right now only 10s of 1000s of users are covered. If there were a few more zeroes on that, standard spam-blocking techniques, currently ineffective, might work. What’s more, the Chinese bureaucracy, currently not highly motivated to shut the service down, might bestir itself to be much more effective.
| Categories: Anonymizer, Privacy, censorship, and freedom, Public policy and privacy, Security and anti-spam, Software as a service | 4 Comments |
Anonymizer — internet privacy through anonymity
I chatted today with Lance Cottrell, the founder and president of Anonymizer. They’re a little 30-40 person company, but even so they do three different interesting kinds of things. In increasing order of importance, these are:
- Provide anonymity services to ordinary individuals.
- Provide anonymity services to enterprises (aka enterprise sneakiness support).
- Help people get through the national firewalls in Iran and China.
| Categories: Anonymizer, Privacy, censorship, and freedom, Public policy and privacy, Security and anti-spam, Software as a service | 3 Comments |
msfirefox — an excellent parody site
Every once in a while, the computer industry comes up with a hilarious parody site. IMO, this site about a Microsoft version of Firefox is one of them.
| Categories: Microsoft | Leave a Comment |
The problem with dashboards, and business intelligence segmented
It is becoming ever clearer that dashboards aren’t working out too well, any more than predecessor technologies like EIS (Executive Information Systems) did. The recurring problem with these technologies is that if they’re mind-numbingly simple, people don’t find them very useful; but if they’re not, people are overwhelmed and still don’t find them useful. This column by Sandra Gittlen does a good job of spelling the problem out.
I think there are lots of problems like that in BI, and what we need to do is step back and consider all the different kinds of BI that enterprises value and need. More precisely, let’s consider the major kinds of use of BI, because it seems that each calls for different kinds of technological support. Here’s one possible list:
- Early warning of situations that require action.
- Communication of company results.
- Deep analysis and decision support.
- Operational analytics.
Here’s what I mean by each category. Read more
KXEN and Verix try to disrupt the data mining market
Data mining is hugely important, but it does have issues with accessibility. The traditional model of data mining goes something like this:
- Data is assembled in a data warehouse from transactional information, with all the effort and expense that requires. Maybe more data is even deliberately gathered. Or maybe the data is in large part acquired, at moderate cost, from third-party providers like credit bureaus.
- The database experts fire up long-running, expensive data extraction processes to select data for analysis. Often, special data warehousing technology is used just for that purpose.
- The statistical experts pound away at the data in their dungeons, torturing it until it reveals its secrets.
- The results are made available to business operating units, both as reports and in the form of executable models.
Each in its own way, KXEN and Verix (the imminent new name of the company now called Business Events) want to change all that.
Read more
| Categories: Analytic technologies, Data mining, Software as a service, Usability and UI, Verix | 7 Comments |
Data mining requires data
Data mining requires and justifies huge investments. The smallest part is the data mining software itself. A much bigger part is the investment in data warehouse technology, a subject about which I’ve been posting extensively recently on DBMS 2.com. But there’s yet another part to the picture, namely investing in actually gathering data for analysis, that I’ve written about, most recently in a blog I posted elsewhere and am now copying below.
Read more
| Categories: Analytic technologies, Data mining | 5 Comments |
Scathing review of Oracle’s pre-Siebel BI products
Stephen Few offers a blistering review of Oracle Discoverer, its portal integration, and its UI in general. This fits well with what I said last November:
Obviously, Oracle has the potential to be a titan in analytics. But it doesn’t have its act at all together yet.
And so I agree with a couple of comments on Stephen’s post, to the effect of “Well, gee, no wonder that Siebel’s BI tools look like they’ll be the surviving technology.”
EDIT: Mark Rittman offers a lot of screenshots of Oracle’s Siebel BI Suite. If you look at other posts on his blog, you’ll see Discoverer as well.
| Categories: Analytic technologies, Business intelligence, DBMS vendors and technologies, Oracle | 1 Comment |
My blogs stopped working through IE!
EDIT: Now they seem to be working again, with no action on my part and no known software updates through the whole process. Go figure. I do not know WordPress well enough to guess just exactly what had to have been broken and then fixed at my hosting provider to have caused these effects.
As of this writing, my blogs (DBMS2, the Monash Report, Text Technologies, and Software Memories) are all working in Firefox, and the top page of each is working in IE, but the rest of the pages/links are NOT working in IE. (But www.monash.com, a non-Wordpress site on the same host, is still working through IE.) Naturallly, I’m addressing this problem as fast as I can. I imagine the fix will involve some sort of a reinstall and/or theme change, which could alter the blogs’ look-and-feel, maybe not for the better (especially at first). I apologize for the inconvenience!
| Categories: About this blog | Leave a Comment |
My actual column on data mining
In a couple of recent posts about data mining, I referenced a Computerworld column due to run September 11. Wonder of wonders, they got it posted on the very first day. Here’s a link.
| Categories: Analytic technologies, Data mining | 4 Comments |