Human Generated Data

Title

Untitled (couple in a wine glass)

Date

1970s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3390

Human Generated Data

Title

Untitled (couple in a wine glass)

People

Artist: Unidentified Artist,

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.8
Apparel 99.8
Person 98.5
Human 98.5
Glass 98.2
Person 95.4
Goblet 93.6
Fashion 92.8
Gown 92.8
Plant 92
Robe 90.7
Flower 88.1
Blossom 88.1
Evening Dress 87.2
Female 85.5
Flower Bouquet 84.4
Flower Arrangement 84.4
Wedding 80
Woman 73.4
Wedding Gown 70.2
Wine Glass 63.5
Alcohol 63.5
Wine 63.5
Drink 63.5
Beverage 63.5
Suit 61.2
Overcoat 61.2
Coat 61.2
Bride 56.9

Imagga
created on 2022-02-26

wineglass 100
wine 86.3
glass 70.6
alcohol 68.8
drink 58.5
beverage 45.6
glasses 40.7
celebration 37.5
party 34.4
liquid 33.2
restaurant 26.1
champagne 25.7
celebrate 23.5
crystal 22.6
anniversary 22.5
bottle 22.4
martini 21.8
table 21.6
holiday 20.1
luxury 19.7
food 19.5
bar 19.4
goblet 17.3
toast 16.5
two 16.1
romantic 16
wedding 15.6
dinner 14.8
grape 14.4
transparent 14.3
romance 14.3
dining 14.3
alcoholic 14.2
new 13.8
pour 13.6
setting 13.5
cocktail 13.5
sweet 13.4
red wine 13.2
cheers 12.7
decoration 12.4
fruit 12.2
festive 12
elegant 12
winery 11.9
year 11.9
dark 11.7
close 11.4
reflection 11.4
love 11.1
refreshment 10.9
liquor 10.8
drinking 10.5
eve 10.5
juice 10.5
bubble 10.4
delicious 9.9
special 9.4
ribbon 9.3
still 9.2
cup 9
dessert 9
pouring 8.8
closeup 8.8
drinks 8.7
lifestyle 8.7
yellow 8.6
life 8.6
gourmet 8.5
splash 8.4
black 8.4
gold 8.2
valentine 8.2
vintage 8
cool 8
silver 8
wine glass 7.9
wines 7.9
bubbly 7.9
reception 7.8
container 7.8
tasting 7.8
date 7.8
cold 7.8
ice 7.7
serving 7.7
occasion 7.7
vine 7.7
refreshing 7.7
still life 7.6
eating 7.6
happy 7.5
barroom 7.5
stem 7.4
dry 7.4
taste 7.4
event 7.4
drop 7.3
color 7.2
fresh 7.2
plate 7.1

Google
created on 2022-02-26

Tableware 97.3
Drinkware 94.7
Stemware 94.5
Wine glass 89.5
Martini glass 87.4
Champagne stemware 85.3
Barware 84
Drink 82.1
Flower 81.5
Recipe 80.7
Art 77.4
Ingredient 77
Serveware 76.8
Petal 74.3
Glass 73.4
Rectangle 73.3
Magenta 70.8
Sunglasses 70.8
Classic cocktail 68.9
Sweetness 67.6

Microsoft
created on 2022-02-26

wine 98.1
indoor 95.9
text 92.8
wine glass 83
glass 76.5
wedding 73.4
rose 70.9
wedding dress 69.7
container 59
bride 52.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Female, 99.9%
Happy 96.4%
Calm 1%
Confused 0.8%
Surprised 0.5%
Fear 0.5%
Disgusted 0.4%
Sad 0.2%
Angry 0.1%

AWS Rekognition

Age 13-21
Gender Male, 97%
Happy 75.5%
Surprised 10.2%
Calm 4.4%
Angry 2.9%
Fear 2.6%
Sad 1.7%
Confused 1.5%
Disgusted 1.2%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a glass of wine 84.6%
a glass of wine on a table 77.3%
a glass of wine sitting on top of a table 63.4%