TYPES OF KNOWLEDGE NEEDED: ========================== 1. Synonyms 2. Hypernyms 3. Noun-adjective associations 4. Adverb-adjective associations, for the general transformation 5. Irregular singular/plurals 6. Noun-verb-adjectives relationships (special case of morphology) 7. Causative/inchoative/stative relationships: 8. Role names and their relation to verb argument positions 9. Verb/Nominalization links (morphology; also see 8. role names) 10. Proper name classification 11. Function/purpose of artifacts (Telic roles). (Some overlap with 12) 12. Typical co-occurences/selectional restrictions. (Some overlap with 11) 13. General knowledge - core theory level 14. Specific world knowledge (esp. definitional knowledge, possibly from WN). 15. Actions: preconditions and effects 16. NN/PP disambiguation: Need to know typical relationships between entities 17. Transfers thru/Transparancy/transformation/metonymy rules 18. Some other specific linguistic challenges: 19. Other database-like world knowledge Notes: * Examples below refer to word senses (classes), rather than just words. * Some refer to H's no longer in the final question set * Some H's require multiple pieces of knowledge Boeing-Princeton-ISI, 12/12/06. ====================================================================== 1. Synonyms 3.H8 {"death penalty","execution"} (in WN) 4.H2 {"buy","purchase"} 5.H2 {"suspend","end"} 13.H2 {"associate","connect"} 14.H4 {"curb","restrict"} 17.H11 {"hit","collide"} 19.H3 {"release"(v),"free"(v)} 25.H4 {"hold","host"} - synonyms (missing in WN) 26.H4 {"commit","promise"} (missing in WN) 28.H5 {"reject","decline"} (in WN) 29.H3 {"enter","get into"} (in WN) 33.H4 {"crowd","people"} (missing in WN) 38.H1 {"own","have"} (in WN) 39.H1 {"many","large number"} (not linked in WN, although each in WN) 42.H1 {"before","sooner"} - (missing in WN) 42.H2 {"after","later"} (in WN) 44.H1 {"great","expert"} (adjectives) (missing in WN) 48.H1 {"acts of terrorism","terrorist acts"} (in WN) 55.H1 {"over","finished"} should be (but aren't) synonyms in WN 58.H3 {"disease","illness"} 2. Hypernyms [Note with verbs, need to match predicate arguments correctly too] 11.H3 demand -> request 14.H4 labor -> people [would like labor -> workers, but not in WN] 15.H6 spike(n) -> increase(n) 18.H5 ban -> prohibit 20.H4 draw -> attract 21.H2 consume -> eat [in WN] 22.H3 witness -> person 27.H1 military -> armed forces 29.H2 stop_v3 -> prevent_v1 (in WN) foodstuff -> food (in WN) 31.H3 escape -> leave (in WN) leave -> move (not in WN; or should this be leave -involves-> move?) fly -> go 32.H1 soldier -> serviceman (in WN) engage -> fight (in WN) 37.H1 delay -> wait 38.H1 golden retriever -> dog 41.H1 order -> ask (not in WN) 42.H1 burn out -> fail (in WN) 45.H1 novel -> book 47.H4 convention -> agreement 48.H1 sponsor(x,y:generic-event) -> supports(x,y). [WN has this] 56.H1 track-down(x,y) -> catch(x,y) [bit strange but in WN] 57.H1 ambush(x,y) -> attack(x,y) [bit strange but in WN] 60.H2 button -> switch (hypernym) 61.H3 hit(x,y) -> arrive-at(x,y) 3. Noun-adjective associations 10.H4 African -> of Africa [e.g., from Africa] 13.H3 mental -> of the mind (e.g., mental decline) 19.H1 Filipino -> from Philippines For people, we need to assert they're citizens/natives 31.H1 Iraqi -> from/to do with Iraq Kuwaiti -> from/to do with Kuwait 4. Adverb-adjective associations, for the general transformation -> e.g., "request forcefully" -> "forceful request" 11.H5 forcefully(r) -> forceful(a) [is in WN] 13.H2 mentally -> mental (mentally declining - mental decline) 5. Irregular singular/plurals 22.H3 witness -> person, so witnesses -> people 6. Noun-verb-adjectives relationships (special case of morphology) There are clear, regular patterns here. 6.H3 armed -> having arms - here the noun (arms) derives the verb (armed) Is there a general rule here? ed -> have ? (but "housed"?) 23.H5 delay(v) - delay(n) - delayed(a) 27.H3 strengthen(v) -> strong(a) ALSO: strengthen(v) -> stronger(a) ; (WN doesn't have -er adjectives) 43.H1 WN [missing] clean up/tidy (v) -> tidy (a) 49.H1,8 dent(v) -> result = a dent(n) 7. Causative/inchoative/stative relationships: John broke the window <-> the window broke <-> The window is broken 52.H1 The man drove to school by car -> The car drove to school. 8. Role names and their relation to verb argument positions (Often morphological; closely related to 9. Verb/nominalizations) 21.H2 consumer -> consume 40.H6 "victim" : x is victim of attack -> x was attacked 44.H2 "tennis player" -> "plays tennis" 47.H1 signatory -> signed 9. Verb/Nominalization links (morphology; also see 8. role names) 1.H1 WN violence (n) -> aggression (n) -> aggress (v) = attack (v) 3.H8 WN execution(n) -> execute(v) 9.H4 performance(n) -> perform(v) 10.H1 "x's adoption of y" -> adopt(x,y) 13.H3 "mental" -> "of the mind" ("mental decline") 15.H4 Tricky: Need "violence" is an event, even though no verbal form. 15.H6 increase(n) -> increase(v) 15.H7 spike(n) -> spike(v) [WN missing this for spike_n5] 15.H2 death -> die 26.H3 recommit(x,y) -> commit(x,y) - this is an interesting one! 31.H1 invasion -> invade 46.H3 "de-" prefix: de -> remove s (decontaminant, decontaminate) 48.H1 "acts of terrorism" <-> "terrorist acts" 57.H1 ambush(e) -> ambush(e,x,y) 65.H1 in general: of -> theme 10. Proper name classification 3.H1 "Hanssen" is a person's name. 4.H1 "A.Q. Khan" is a person's name. 6.H1 "Associated Press" is a company name. 8.H1 "Jeffery Skilling" is a person's name, "Enron" a company. 9.H1 "Apple" is a company name. 26.H1 "Dell" is a company name. 27.H1 "the Gulf" is a place. 30.H1 "Panam" is (was) an commercial airline. 38.H1 "Golden Retriever" is a breed of dog. 11. Function/purpose of artifacts (Telic roles). (Some overlap with 12) 31.H3 airplanes typically fly 39.H3 purpose(camera,photograph) ; ? 52.H1 come by car -> drive by car 12. Typical co-occurences/selectional restrictions. (Some overlap with 11) 17.H4 move(train,to b,on c) -> c = track ; trains typically move on tracks 30.H2 fly(x,y) -> [probably] isa(x,airplane) 41.H2 "ordering food" typically happens in a restaurant 45.H2 read(x,y) -> [probably] isa(y,written-material) 47.H5 sign(x,y) -> [probably] isa(y,document). 13. General knowledge - core theory level 9.H3 X improves -> X makes better [WN has this] 11.H2 demand(x,y) -> want(x,y) ; is this a precondition or implication? 13.H2 "x becomes y" -> y(x) ; e.g., "become old" 13.H3 Symmetry: connected(x,y) -> connected(y,x) 15.H2 (,), in(,) -> (,) ; e.g., "see spike in X" -> "see X" 15.H3 The below is a rather heuristic rule about colocation: (x,y,location z) -> location(x,z), location(y,z) Similar one for contemporoneity. 15.H4 For human events: (agent,...) <-> causes(agent,) 15.H8 increase(in x) -> greater(x) 15.H9 increase(in x) -> more(x) 15.H10 spike in x -> x (e.g., x = violence) 20.H4 attract(x,y) -> want(y,(y,x)) e.g., x = orchestra, = listen to Attraction causes desire, but the nature of that desire depends on the situation, e.g., orchestra attracts crowds -> crowds want to listen to the orchestra. 23.H5 later(a) -> late(a) - is this ok? Often true for all comparatives? 24.H3 engage(x,y,for ) -> (y,for x) ; engage for work -> work 25.H1 -> occurs-in(,) ; "winter olympics" 27.H1 Special behavior of "presence": "Military presence" -> "Military" 27.H3 More soldiers -> stronger force ; very hard! Or more generally: what does "strengthen" mean in different contexts? 28.H5 decline(x,y) -> not(want(x,y)) 29.H1 deliver(x,y,to z) -involves-> enter(x and y,z) ; heuristic & see 31.H3 29.H2 If an action is prevented, then the action (or any action requiring it) cannot happen. How to formalize this? 30.H4 events and objects are typically (when?) all in close proximity. 30.H6 [typically] damaged things can't perform their function: function(x,(..x..)) & damaged(x) -> not((..x..)) 31.H3 leave -involves-> move (see 29.H1 also) 33.H3 allow(x,) -> ; pragmatic not logical implication 33.H4 allow(x,(y,z)) -> want(y,(y,z)) ; pragmatic rule 34.H1 Handling negation: forbid x -> require not(x). See also "Some specific linguistic challenges" below. 35.H3 forbid(x,) -> not(want(x,)) 36.H1 "try"? try-to(x,) -> want(x,)? goal(x,)? 37.H1 Heuristic: agree(x,to ) -> 39.H2 IF X is a typical example of Y THEN many instances of Y have X's properties. How do formalize this? 39.H3 have(x,y) & purpose(y,) -> capable-of(x,(x,?)) e.g., have a camera -> can take pictures 39.H4 part(x,y) part(y,z) -> part(x,z) ; Part transitivity 41.H1 ask(x,y,for z) -> want(x,z) 42.H3 The notion of something "lasting": lasts(x,until y) -> fails(x,at y)? 44.H2 Need a scale: "bad", "average", "good", "great" to relate these. 46.H3 IF X gets Y THEN X wants to perform the thing that Y is intended to be used for 46.H3 IF someone provides somebody with X THEN the somebody wants X. 49.H7 (x) & part-of(x,y) -> (y) 53.H1 cool(x,y) -> cooler(y) [with respect to what?] - can generalize this? 65.H4 IF X is part of Y, and Y is an artifact THEN X is used by Y (?) 14. Specific world knowledge (esp. definitional knowledge, possibly from WN). Some might be represented using FrameNet style frames. 1.H4 violence -causes-> damage ; or causality in general 2.H4 test(x) -> make x do its thing, and study the results test(x,y) & purpose(y,) -> (x,y) & observe(x,result()) 3.H6 X sells Y to Z -> X receives money from Z 8.H10 sentence(x,y) -entails-> convict(x,y) [this one's there] 15.H7 spike(x) -> increase(x), decrease(x) 16.H6 bleed(x) -> lose(x,blood) 17.H3 hit/collide(x,y) -> move(x) ; e.g., x = train. [WN doesn't have this] 17.H10 hit(x,y) -> injure(x,y) [not in WN] 22.H1 delays(organization, release(x)) -> not( on-time(release(x))) 46.H1 provide -isa-> transfer -perspectives-> give, receive 48.H1 sponsor(x,y:generic-event) -> supports(x,y). [WN has this] 52.H2 drive(x,y) -> transport(x,y) 52.H3 x transports y -> [typically] x contains y 53.H2,3 cool(x,y) -> reduce(x,temperature(y)) 54.H1 visit(x,y) -> travel(x, to y) 56.H2 track-down(x,y) -> find(x,y) 56.H3 track-down(x,y) -> chase(x,y) 57.H2 ambush(x,y) -> precondition(concealed(x)) & attack(x,y,by[manner] z) & surprise(z) 57.H3 ambush(x,y) -> people(x) & concealed(x) 58.H1 is-authority-on(x,y) -> has-expertise-about(x,y) 59.H1 buy(x,y,from z) -> pay(x,y,amount a,for z) 62.H2 search(x,y,for z) -> try(find(x,z,in y)) 63.H2 rocket_v(x,y) -> propel with a rocket 65.H2 recall(x,y) -> defective(y) - WN gives us this 15. Actions: preconditions and effects NB: Really want to interpret "-> effect()" as "-causes-> effect()" to answer causality questions (e.g., 30.H4) 4.H2 buy(x,y,from z) -> precondition(has(z,y)) 4.H4 buy(x,y,from z) -> sell(z,y,to x) 4.H7 buy(x,y) -> effect(has(x,y)) 5.H3 x ends of y -> precondition((x,y)) 9.H3 make(x,) -> effect() ; also see 53.H1 11.H1 stop() -> precondition() (eg. "stop producing") 12.H6 remove(x,y,from z) -> precondition(on(y,z)) ; not always true! 26.H3 commit(x,y) -> precondition(want(x,y)) 29.H4 enter(x,y) -> precondition(outside(x,y)) 30.H4 explode(x) & near(x,y) -> effect(damaged(y)) 46.H2 provide(x,y,with z) -> precondition(possesses(x,z)) 49.H3 dent(x,y) -> effect(damaged(y)) [FrameNet has this] 49.H8 dent(x,y) -> effect(dented(y)) 51.H1 travel(x,to y) -> effect(location(x,y)) 53.H1 "make cooler" -> cool ; also see 9.H3 55.H2 stay(x,in y) -> in(x,y) 59.H2 buy(x,y) -> has(x,y) or postcondition(has(x,y)) 59.H3 buy(x,y) -> [probably] precondition(want(x,y)) 16. NN/PP disambiguation: Need to know typical relationships between entities 1.H2 "last night's violence" -> "during last night" 2.H3 "test missile" -> "missile was tested" 3.H3 "FBI secrets" -> "secrets owned by FBI" 8.H2 "Enron executive X" -> X worked for Enronxo 19.H2 "baby David" -> baby named David 17.H2 "Union Pacific train" -> train operated by Union Pacific 19.H1 "Filipino hostage" -> hostage nationality Philippines 25.H1 "Winter Olympics" -> Olympics during winter 27.H1 "military force" -> "military", "red color" -> "red" (special type of NN compound) 27.H1 "in the Gulf" -> "located in the Gulf" 49.H4 "dented in an accident" -> accident caused the denting, denting was during the accident. 44.H2 NN compound manipulation: "tennis player" -> "plays tennis" 65.H2 "laptop batteries" -> batteries part-of/used-in/used-by laptops 17. Transfers thru/Transparancy/transformation/metonymy rules 3.H8 receives(x,) -> (y,x) Also others: performs(x,), etc. 5.H4 (x,y) -> decide(,to ) for intensional s only 6.H3 "Group of men" -> "men" (also see 17.H11) 7.H1 do(x,) -> (x,y) 8.H9 ;;; "x sentenced for a murder" -> "x murdered" sentence(x,y,for ) -> (y,z) ;;; "x led a deception" -> "x deceived" lead(x,) -> (x,y) 9.H3 make(x,) -> [or is this an "effects" rule?] 11.H3 make(x,) -> ("make a request" -> "requests") [Only for some nominalizations. Which ones?] Also see 35.H1. 14.H4 "put/place curbs(n) on" -> "curb"(v) - can we generalize this? 17.H11 "people" <-> "group of people" (also see 6.H3) 19.H3 x frees y -> x lets y go free 20.H2 Japan -> people of Japan (see also 35.H1,58.H2) 24.H3 engage(x,y,for ) -> (y,for x) ; engage for work -> work 30.H3 "managed to escape" -> "escaped" [for many verbs] 32.H1 "begin a fight" -> "fight" 34.H1 work(v) -> have work(n) ; or some generalization of this 35.H1 "decide" -> "make a decision" (also see 9.H3) Administration -> people in the Administration (see also 20.H2,58.H2) 37.H1 Heuristic: agree(x,to ) -> wait(x,on/to ) -> delayed() ; bit specific (?) The causality chain: causes(x,y), result(y,z) -> causes(x,z) 58.H2 "tranfer through" rules, such as: has(x:agency,y:expertise) -> has(x:agency,z:person), has(z:person,y:expertise) [Or could view this as metonymy. See 20.H2,35.H1 also] 18. Some other specific linguistic challenges: 11.H2 "demand that" -> "want" - how to handle the "that" (also see 26.H4) 16.H2 "X bled to death" -> death is of X IF X is the agent of Y, and the result of Y is Z THEN X is the agent of Z. 17.H4 aligning the prepositions [train] "on track" = "along track" = path is a track 22.H3 NN manipulation "gas canister" -> "canister of gas" 26.H1 How to handle idioms like "doing its best" (also see 39.H3) 26.H4 "promise that" -> "commit" - how to handle "that" (also see 11.H2) 29.H1-3 Handle "cannot", as in "Food cannot be delivered" 30.H1 Recognizing numbered instances, e.g., "flight 103" 31.H3 Particle verbs - should WN enumerate all these? fly away, move away, run away, slink away... 32.H1 Handling two-agent events, e.g., fight, react: fight(x,against/with y) <-> fight(x,y) 34.H1 Expressing negation linguistically: "women have a job" -> "women do not have a job"/"women cannot have a job" 36.H4 Negation: "without x" -> "have no x" 39.H3 How to handle idiom "take pictures"? (also see 26.H1) 41.H1 " of " -> quantity(,) (cf. "the engine of the car" -> engine vs. "10kg of meat" -> meat) 42.T Filling in ellipsis: "Incandescent bulbs burn out sooner than LEDs [burn out]." 42.H1 "before" <-> "sooner than": How do we handle "than"? 19. Other database-like world knowledge 32.H1 type-has-member-type(troop,serviceman) 39.H4 part(camera,lens) 42.H2 antonyms: before(x,y) <-> after(y,x) -- end --