Search the web
Sign In
New User? Sign Up
CEP-Interest · Event Processing Technologies
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Message search is now enhanced, find messages faster. Take it for a spin.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
How would you solve this simple problem?   Message List  
Reply | Forward Message #2000 of 2137 |
Re: [CEP-Interest] How would you solve this simple problem?

Dear all,

Let me recast this question and address some of the comments and
answers. But first, thanks to all, it was an impressive set of
detailed answers.

Luis is working in our research group at the University of Coimbra and
we have talked about this and other similar questions. The issue is
not about whether this is CEP or not. [A more CEP-ish, similar query
is: what is the moving 5-min avg of X (e.g., temperature, stock value,
dice roll values)? - we argue that the answer is not as clear cut as
it seems.]

The issue is one of syntax and semantics. Regarding syntax, we expect
that simple English queries can be translated into simple CEP
expressions. What we noticed is that in a few cases, the semantics of
the engines are that simple English queries:
a) can be translated into simple CEP expressions but those expressions
do not return what we expected; or
b) to get the semantics we want, we are forced to write CEP
expressions significantly more complex then what we expected.

Regarding the state of the CEP field, my personal impression is that,
as also mentioned in one of the panels at the EPTS'08 Symposium, if
anything CEP is under-hyped. Several tech-savvy managers we have
talked with were unaware of CEP companies, products, and technology
even though they have systems were CEP engines could shine.

Also, this thread is not bad press for CEP. Ok, there is room for
improvement and some queries do not translate easily into CEP
expressions, but apart from those queries, we have been quite
impressed with the engines in terms of usability, integration, user
support, and performance. Some of the companies we give advice to have
been happily surprised too.

Regards,
Pedro


On Sun, Jan 4, 2009 at 00:04, pureza_l <pureza_l@...> wrote:
> Hi,
>
> I have the good old StockTrades stream with two fields: symbol and
> price. I'm trying to answer the following question "Were Company X
> stock actions priced above $70 during any moment of the last 5 minutes?".
>
> Unfortunately, using a simple time-based sliding window won't work. To
> see why, imagine there were only two price updates: the first, at
> 10:54 am stated that stocks were at $71. The second, 2 minutes later,
> notified that the stocks went down to $69. Now imagine that the above
> question was posed at 11:00 am (of the same day). We, humans, know
> that the answer is "yes" because the price was $71 between 10:54 and
> 10:56. But the first event is outside the 5 minutes window and will
> thus be ignored by the system.
>
> How would you solve this?
>
> Thanks,
>
> Luís Pureza
>
>
> ------------------------------------
>
> Yahoo! Groups Links
>
>
>
>


Tue Jan 6, 2009 1:36 am

p_bizarro
Offline Offline
Send Email Send Email

Forward
Message #2000 of 2137 |
Expand Messages Author Sort by Date

LastAction: With what I suggested, you need to know the current price so as to know if it exceeds $70. Also, when the next price shows up, then you need...
Bob Hagmann
bob_hagmann
Offline Send Email
Jan 5, 2009
5:43 pm

Dear all, Let me recast this question and address some of the comments and answers. But first, thanks to all, it was an impressive set of detailed answers. ...
Pedro Bizarro
p_bizarro
Offline Send Email
Jan 6, 2009
1:36 am

Here's my 2 cents based on first hand experience implementing natural language rule editing. regarding A, the english has to be translated to logic first,...
Peter Lin
woolfel
Offline Send Email
Jan 6, 2009
2:40 am

I think the major issue that “simple” queries like these highlight, is that most Complex Event Processing implementations are designed to take into account...
David Tucker
flyguyd
Offline Send Email
Jan 6, 2009
3:01 am

I disagree---I think it is a flaw in design. Yes, vendors are still exploring the design space of CEP; what bothers me is that there's not enough theory to...
Jon Riecke
jon_riecke
Online Now Send Email
Jan 8, 2009
4:04 am

Hello Pedro. The main issue with this query is that it is not a query that deals directly with the event history, but with the temporal semantics imposed by...
Opher Etzion
o_etzion
Offline Send Email
Jan 6, 2009
4:52 am

Esper actually indexes the named window contents based on the predefined query. Thereby predefined queries *can* become much less expensive to execute. Below...
Thomas Bernhardt
bernhardttom
Offline Send Email
Jan 6, 2009
12:38 pm

Hi Luis: congrats on tasking the CEP community with another apparent conundrum! I drafted a reply yesterday but thought it too obvious - today I see the debate...
isvana321
Online Now Send Email
Jan 6, 2009
2:04 pm

Hi, I'll try to answer your questions. ... Yes. ... I purposely described the query as a static, ad-hoc one, to simplify. But you may as well want to perform...
Luis Pureza
pureza_l
Offline Send Email
Jan 6, 2009
3:43 pm

Hi Luis, Of course this is an event processing problem. You just did not word it in a way to make it sound like one for the EP crowd, LOL: Event A: "Company X...
Tim Bass
tim_tibco
Offline Send Email
Jan 6, 2009
5:31 pm

Tim, ... Is this just an obtuse way of agreeing that the problem as posed isn't an event processing problem without seeming to agree? :-) ... Being pedantic,...
Brian Connell
cep_ws_bam
Offline Send Email
Jan 6, 2009
5:56 pm

I'm enjoying this discussion. anyone else notice that a slight change in the semantics of the patterns ends up changing the problem? Phrased one way, the...
Peter Lin
woolfel
Offline Send Email
Jan 6, 2009
6:08 pm

So in all this, there seems to be exactly one piece classification that comes with any kind of real theory on why it matters. On one hand, we might interpret...
hansgilde
Offline Send Email
Jan 6, 2009
9:17 pm

If I read the response correctly, I think we are mostly in agreement. from my perspective, classifying a problem as EP or not isn't important. what matters...
Peter Lin
woolfel
Offline Send Email
Jan 6, 2009
9:45 pm

... "Was IP address X logged in anytime during the 3 weeks before IP address Y logged in". Brian...
Brian Connell
cep_ws_bam
Offline Send Email
Jan 6, 2009
6:00 pm

Hello all, very interesting discussion clearly showing the limitations of (timed) windows and data streaming/continuous queries approaches to CEP. I am with...
PatternStorm
claudi_p
Offline Send Email
Jan 7, 2009
1:22 am

I can see some benefits to modeling this way and in this particular example, your sequence technique looks to be complimentary with the streaming SQL approach....
hansgilde
Offline Send Email
Jan 7, 2009
3:50 am

Well, not really ... First: When you reduce the problem to simple 5 minute sliding windows, yes it looks like a streaming SQL approach. However, the vast ...
Tim Bass
tim_tibco
Offline Send Email
Jan 7, 2009
5:53 pm

Yes, in real-world things does not happen in neat-little 5 minute windows. You'll get minutes of in-activity and then thousands of ticks in a fraction of a...
Fatih Ildiz
fildiz57
Online Now Send Email
Jan 7, 2009
6:10 pm
 First  |  |  Next > Last 
Advanced

Copyright 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help