Human Generated Data

Title

Untitled (bride and groom opening gifts)
Date

1970s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3308

Human Generated Data

Title

Untitled (bride and groom opening gifts)

People

Artist: Unidentified Artist,

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 98.5
Apparel 98.5
Person 98.3
Human 98.3
Person 97.7
Furniture 93.5
Table 81.7
Home Decor 76.7
Coat 66.6
Overcoat 66.6
Suit 63.6
Fashion 62.3
Gown 62.3
Robe 59.4
Bed 58.7
Alcohol 56.3
Drink 56.3
Liquor 56.3
Beverage 56.3
Text 56
Tuxedo 55.3

Imagga
created on 2022-02-26

groom 28.6
adult 27.1
table 25
person 24
happy 23.8
people 23.4
man 22.9
couple 21.8
home 20.7
smiling 18.8
male 17.7
business 17.6
happiness 16.5
laptop 15.5
sitting 15.5
computer 15.2
lifestyle 15.2
drink 15
indoors 14.9
office 14.9
businessman 14.1
day 14.1
desk 14.1
cheerful 13.8
indoor 13.7
women 13.4
interior 13.3
room 12.8
businesswoman 12.7
suit 12.6
attractive 12.6
house 12.5
container 12.3
smile 12.1
food 11.6
dinner 11.5
box 11.4
meeting 11.3
corporate 11.2
celebration 11.2
love 11
two 11
beverage 10.9
clothing 10.8
30s 10.6
adults 10.4
executive 10.4
emotion 10.1
wedding 10.1
color 10
confident 10
work 9.9
family 9.8
husband 9.7
new 9.7
businesspeople 9.5
chair 9.5
party 9.5
20s 9.2
stall 9
job 8.8
looking 8.8
glass 8.6
wife 8.5
expression 8.5
pen 8.5
teamwork 8.3
cup 8.1
group 8.1
kitchen 8
paper 8
professional 8
together 7.9
holiday 7.9
portrait 7.8
worker 7.7
old 7.7
casual 7.6
child 7.6
shop 7.5
senior 7.5
alcohol 7.4
tea 7.3
restaurant 7.3
success 7.2
meal 7.2
blond 7.2
team 7.2
bright 7.1
romance 7.1
romantic 7.1
face 7.1
working 7.1

Google
created on 2022-02-26

Smile 90.9
Bride 88.6
Wedding dress 77.6
Vintage clothing 76.4
Event 72.7
Formal wear 72.4
Suit 71.6
Beard 69.6
Rectangle 69.5
Room 67.3
Sunglasses 67.2
Art 65.6
Flower Arranging 65.1
Box 61
Paper product 60.6
Visual arts 59.4
Photographic paper 57.9
Floral design 56.9
Ceremony 52.5
Paper 52.5

Microsoft
created on 2022-02-26

wedding dress 94.8
bride 90
indoor 89.6
wedding cake 86.3
person 85.5
funeral 80.8
wedding 78.9
text 74.3
woman 67
flower 60.3
birthday cake 59.8
clothing 52.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Happy 88.2%
Calm 3.2%
Confused 2.5%
Surprised 2.4%
Angry 1.6%
Disgusted 1%
Fear 0.8%
Sad 0.5%

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Happy 89.7%
Fear 5.7%
Surprised 2.6%
Calm 0.6%
Angry 0.4%
Confused 0.4%
Disgusted 0.3%
Sad 0.3%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a person sitting in a box 61.3%
a person standing in front of a box 61.2%
a person in a box 61.1%

Text analysis

Amazon

BEACON
1
-
...
LEGENCY
GO
a

Google

BEACON
BEACON