Human Generated Data

Title

Untitled (three women chatting at punch bowl at party)

Date

1959

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9662

Human Generated Data

Title

Untitled (three women chatting at punch bowl at party)

People

Artist: Martin Schweig, American 20th century

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.4
Person 99.4
Person 99
Person 97.4
Wedding Cake 89.7
Dessert 89.7
Cake 89.7
Food 89.7
Female 86.8
Plant 84.3
Meal 81.3
Furniture 80.3
Face 79
Table 77
Indoors 75.9
Room 72.6
Woman 72.4
Blossom 69.5
Flower 69.5
Restaurant 66.8
Cafeteria 64.8
Girl 63.3
Photo 63.2
Portrait 63.2
Photography 63.2
Dining Table 63.1
People 60.9
Clothing 60.7
Dress 60.7
Apparel 60.7
Hair 59.6
Flower Arrangement 55.5

Imagga
created on 2022-01-23

sax 41
person 28.8
man 28.2
people 25.1
wind instrument 24.5
male 20.6
adult 20.1
musical instrument 19.8
couple 18.3
brass 17.6
business 17.6
home 15.1
drink 15
businessman 15
wine 14.8
happy 14.4
professional 14
interior 13.3
table 13.3
room 12.8
attractive 12.6
holding 12.4
portrait 12.3
bartender 12.2
smile 12.1
office 12
indoor 11.9
indoors 11.4
black 11.4
device 11.3
sexy 11.2
dinner 11
lifestyle 10.8
worker 10.8
vintage 10.7
pretty 10.5
party 10.3
sitting 10.3
men 10.3
cornet 10.2
smiling 10.1
glass 10.1
restaurant 10
cheerful 9.7
style 9.6
chair 9.6
celebration 9.6
drinking 9.6
women 9.5
manager 9.3
alcohol 9.3
communication 9.2
fun 9
handsome 8.9
job 8.8
looking 8.8
work 8.6
happiness 8.6
executive 8.6
holiday 8.6
corporate 8.6
elegant 8.6
meeting 8.5
senior 8.4
music 8.4
elegance 8.4
old 8.4
event 8.3
horn 8.3
fashion 8.3
retro 8.2
businesswoman 8.2
lady 8.1
food 8.1
suit 8.1
romance 8
night 8
bouquet 7.8
standing 7.8
bride 7.7
studio 7.6
hand 7.6
teacher 7.4
service 7.4
waiter 7.4
confident 7.3
group 7.3
guitar 7.2
kitchen 7.2
romantic 7.1
family 7.1
stringed instrument 7.1

Google
created on 2022-01-23

Photograph 94.2
Plant 93
Picture frame 92.3
Flowerpot 89.8
Black 89.7
Houseplant 88.3
Fashion 87.7
Window 84.6
Black-and-white 84.1
Style 83.8
Monochrome photography 74.8
Snapshot 74.3
Display case 74.1
Flower 74
Monochrome 71.6
Art 70.9
Event 70.3
Room 69.9
Font 68.1
Flower Arranging 67.4

Microsoft
created on 2022-01-23

text 97.7
indoor 96.4
window 95.7
person 89.1
clothing 84.3
wedding 75.8
vase 72.5
black and white 55.5

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Female, 99.3%
Surprised 71.5%
Happy 18%
Calm 3.9%
Sad 2%
Fear 1.9%
Angry 1.2%
Disgusted 1%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Wedding Cake 89.7%

Captions

Microsoft

a group of people sitting at a table in front of a window 78%
a person sitting at a table with a cake in front of a window 56.7%
a man and a woman sitting at a table in front of a window 56.6%

Text analysis

Amazon

t
231 L' t
L'
231
MUE--YT33X