Human Generated Data

Title

Untitled (two photographs: elevated view of guests chatting at wedding reception; large group portrait of guests at wedding reception)
Date

1949, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12376

Human Generated Data

Title

Untitled (two photographs: elevated view of guests chatting at wedding reception; large group portrait of guests at wedding reception)

People

Artist: Martin Schweig, American 20th century

Date

1949, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12376

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.5
Person 99.5
Person 99.4
Person 99.1
Person 98.8
Person 98.6
Person 98.5
Person 98
Person 97.1
Person 96.3
Collage 96.2
Advertisement 96.2
Poster 96.2
Person 95.6
Person 94.9
Person 94.4
Person 94.1
Person 92.2
Person 92.2
Person 92.1
Person 91.8
Person 90.4
Person 88.6
Person 88.2
Person 87.5
Person 87.2
Person 82.4
Person 72
Person 68.7
Person 68.7
Person 64.3
Crowd 63.6
Chef 62.1
Clothing 61.4
Apparel 61.4
Person 60.5
Restaurant 59.8
Cafeteria 59.8
Person 52.3
Person 46.2

Clarifai
created on 2019-11-16

people 100
many 99.7
group 99.3
group together 98.8
adult 98.7
man 96.9
wear 94.3
outfit 93.8
leader 93.3
woman 92.7
audience 92.5
crowd 91.6
administration 91.4
music 85.9
chair 83
military 82.7
furniture 82.1
several 80.9
room 80.3
movie 80.1

Imagga
created on 2019-11-16

shop 38.4
barbershop 34.4
brass 33.1
wind instrument 27.3
mercantile establishment 25.3
musical instrument 23.7
place of business 16.9
man 16.8
black 16.8
cornet 15.6
male 15.6
window 15.4
people 14.5
group 12.1
person 11.1
business 10.9
urban 10.5
glass 10.2
city 10
silhouette 9.9
old 9.7
men 9.4
light 9.3
fashion 9
design 9
salon 8.8
couple 8.7
art 8.5
grunge 8.5
establishment 8.4
dress 8.1
adult 7.8
modern 7.7
wall 7.7
trombone 7.4
vintage 7.4
bass 7.4
retro 7.4
graphic 7.3
office 7.2
color 7.2
clothing 7.2
sexy 7.2
colorful 7.2
night 7.1

Google
created on 2019-11-16

Photograph 97.5
Snapshot 87.6
Black-and-white 85.4
Photography 81
Art 75.5
Monochrome photography 69.6
Photograph album 66.3
Event 62.7
Stock photography 62.1
Collage 61.4
Photomontage 58
Photographic paper 55
Monochrome 54.4
Team 52.3

Microsoft
created on 2019-11-16

person 99.8
clothing 98.6
posing 97.2
text 96.6
man 94.9
group 94.1
black and white 86.8
standing 76.1
black 65.2
old 61.9
woman 58.6
people 57.7
line 19.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 50-68
Gender Male, 54.5%
Disgusted 45%
Confused 45.1%
Angry 45.1%
Happy 45%
Sad 50.3%
Calm 49.5%
Surprised 45%
Fear 45%

AWS Rekognition

Age 12-22
Gender Male, 52.6%
Happy 45%
Calm 54.6%
Fear 45%
Confused 45%
Angry 45.2%
Surprised 45%
Disgusted 45.1%
Sad 45.1%

AWS Rekognition

Age 49-67
Gender Male, 54.3%
Fear 45.1%
Confused 45.2%
Calm 48.8%
Sad 47.8%
Disgusted 45%
Happy 45.1%
Surprised 45%
Angry 47.9%

AWS Rekognition

Age 31-47
Gender Female, 52.2%
Angry 45%
Sad 46.6%
Confused 45%
Disgusted 45%
Surprised 45%
Happy 53.3%
Fear 45%
Calm 45%

AWS Rekognition

Age 46-64
Gender Male, 54.7%
Angry 45.2%
Fear 45.1%
Confused 45.3%
Surprised 45.2%
Calm 47%
Disgusted 45.3%
Sad 46.3%
Happy 50.5%

AWS Rekognition

Age 51-69
Gender Male, 54.9%
Calm 46%
Fear 47.2%
Confused 45.3%
Happy 45.6%
Angry 49.4%
Disgusted 45.3%
Sad 45.3%
Surprised 45.9%

AWS Rekognition

Age 32-48
Gender Male, 54.1%
Angry 45.1%
Happy 45.1%
Disgusted 45.1%
Fear 45%
Confused 45%
Surprised 45.1%
Calm 54.4%
Sad 45.1%

AWS Rekognition

Age 30-46
Gender Female, 54.8%
Calm 45%
Surprised 45.1%
Angry 45.2%
Confused 45%
Happy 54.5%
Fear 45%
Sad 45%
Disgusted 45.1%

AWS Rekognition

Age 47-65
Gender Male, 54.9%
Disgusted 45.2%
Happy 45.2%
Angry 45.7%
Confused 45.3%
Calm 46.3%
Fear 45.1%
Sad 52.1%
Surprised 45.1%

AWS Rekognition

Age 23-35
Gender Female, 50.4%
Disgusted 45.1%
Angry 45.1%
Confused 45%
Calm 45%
Sad 45.3%
Happy 54.4%
Surprised 45.1%
Fear 45.1%

AWS Rekognition

Age 48-66
Gender Male, 54.6%
Calm 48.9%
Sad 45.4%
Fear 45%
Confused 50.4%
Angry 45.1%
Happy 45%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 52-70
Gender Male, 54.8%
Fear 45%
Confused 45.2%
Calm 53.5%
Sad 45.1%
Disgusted 45.4%
Happy 45.5%
Surprised 45.1%
Angry 45.3%

AWS Rekognition

Age 46-64
Gender Male, 53.1%
Disgusted 45.4%
Fear 45.5%
Calm 49%
Surprised 48.1%
Angry 45.7%
Confused 45.6%
Happy 45.3%
Sad 45.4%

AWS Rekognition

Age 39-57
Gender Male, 53.3%
Confused 45.4%
Calm 49.9%
Surprised 45.3%
Fear 45.1%
Happy 45.2%
Angry 46%
Sad 47.9%
Disgusted 45.2%

AWS Rekognition

Age 51-69
Gender Female, 55%
Confused 45.5%
Disgusted 45.7%
Surprised 45.2%
Calm 45.6%
Angry 46.6%
Sad 49.3%
Happy 45.5%
Fear 46.6%

AWS Rekognition

Age 34-50
Gender Male, 53.6%
Fear 45.7%
Surprised 45.5%
Angry 46.1%
Calm 45.4%
Sad 45.7%
Happy 51.3%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 5-15
Gender Female, 50.1%
Surprised 45.2%
Calm 45.6%
Happy 52.7%
Angry 45.4%
Fear 45.3%
Sad 45.4%
Confused 45.1%
Disgusted 45.2%

AWS Rekognition

Age 52-70
Gender Male, 54.6%
Calm 49%
Sad 45.2%
Happy 49.2%
Angry 45.4%
Fear 45.1%
Confused 45.2%
Surprised 45.6%
Disgusted 45.3%

AWS Rekognition

Age 51-69
Gender Male, 54.4%
Surprised 45%
Fear 45%
Angry 45%
Happy 54.8%
Sad 45%
Confused 45%
Calm 45.1%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Male, 54.8%
Sad 45%
Surprised 45.1%
Angry 45.1%
Calm 45.6%
Happy 53.9%
Fear 45%
Disgusted 45.2%
Confused 45.1%

AWS Rekognition

Age 36-52
Gender Female, 51.1%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%
Surprised 45%
Calm 45%
Fear 45%
Sad 55%

AWS Rekognition

Age 48-66
Gender Male, 54.5%
Calm 45.2%
Confused 45%
Happy 54.1%
Surprised 45.1%
Sad 45.2%
Fear 45.1%
Angry 45.2%
Disgusted 45.2%

AWS Rekognition

Age 50-68
Gender Male, 54.4%
Surprised 45%
Calm 54.4%
Fear 45%
Disgusted 45%
Happy 45.5%
Angry 45%
Sad 45%
Confused 45%

AWS Rekognition

Age 24-38
Gender Female, 54.6%
Sad 45.1%
Fear 45%
Angry 45%
Surprised 45%
Confused 45%
Calm 45%
Happy 54.8%
Disgusted 45%

AWS Rekognition

Age 37-55
Gender Male, 54.2%
Angry 45.1%
Sad 45.1%
Confused 45.1%
Calm 50%
Surprised 45.4%
Happy 49.2%
Disgusted 45.1%
Fear 45.1%

AWS Rekognition

Age 51-69
Gender Female, 54.9%
Calm 46.9%
Disgusted 45.4%
Happy 50.4%
Fear 45.1%
Confused 45.2%
Angry 45.2%
Surprised 45.3%
Sad 46.4%

AWS Rekognition

Age 51-69
Gender Male, 54.4%
Fear 45.2%
Surprised 45.2%
Angry 45.3%
Calm 45.7%
Sad 46%
Happy 50.2%
Disgusted 47.1%
Confused 45.3%

AWS Rekognition

Age 20-32
Gender Male, 54.7%
Fear 45.1%
Calm 48.4%
Disgusted 45.5%
Happy 50%
Sad 45.5%
Confused 45.1%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 2-8
Gender Female, 50.5%
Sad 45%
Surprised 45%
Angry 45.2%
Confused 45%
Fear 45%
Happy 54.6%
Calm 45.2%
Disgusted 45%

AWS Rekognition

Age 52-70
Gender Male, 50.7%
Angry 45.2%
Happy 53.5%
Disgusted 45.1%
Surprised 45.2%
Fear 45.2%
Sad 45.5%
Confused 45.1%
Calm 45.2%

AWS Rekognition

Age 23-35
Gender Male, 54.6%
Happy 45.1%
Confused 45%
Calm 45.1%
Fear 45.1%
Angry 54.5%
Surprised 45%
Disgusted 45.1%
Sad 45%

AWS Rekognition

Age 16-28
Gender Female, 50.4%
Confused 49.6%
Surprised 49.6%
Sad 49.6%
Calm 49.6%
Disgusted 49.7%
Happy 49.6%
Fear 49.7%
Angry 49.6%

AWS Rekognition

Age 51-69
Gender Male, 54.7%
Calm 45.2%
Surprised 45.1%
Angry 45%
Confused 45.1%
Happy 54.5%
Fear 45%
Sad 45.1%
Disgusted 45%

AWS Rekognition

Age 12-22
Gender Female, 50.2%
Angry 49.5%
Sad 49.8%
Confused 49.6%
Calm 49.6%
Surprised 49.5%
Happy 49.6%
Disgusted 49.5%
Fear 49.8%

AWS Rekognition

Age 18-30
Gender Female, 50.9%
Happy 45.3%
Angry 47.2%
Disgusted 45.2%
Confused 45.2%
Sad 50.7%
Calm 46%
Surprised 45.1%
Fear 45.4%

AWS Rekognition

Age 23-37
Gender Male, 54.5%
Disgusted 45%
Fear 45%
Confused 45%
Calm 54.2%
Surprised 45%
Angry 45%
Sad 45.6%
Happy 45%

AWS Rekognition

Age 51-69
Gender Male, 54.7%
Confused 45%
Surprised 45%
Sad 54.4%
Disgusted 45%
Calm 45.5%
Fear 45%
Angry 45.1%
Happy 45%

AWS Rekognition

Age 12-22
Gender Male, 50.6%
Fear 53.1%
Sad 46.1%
Angry 45.6%
Calm 45%
Confused 45.1%
Disgusted 45.1%
Happy 45%
Surprised 45%

AWS Rekognition

Age 48-66
Gender Female, 50.2%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%
Fear 49.5%
Disgusted 50.1%
Sad 49.7%
Surprised 49.5%

AWS Rekognition

Age 16-28
Gender Female, 50.8%
Confused 45.1%
Calm 45.3%
Surprised 45%
Fear 45.1%
Happy 45%
Angry 45.5%
Sad 53.8%
Disgusted 45.1%

AWS Rekognition

Age 27-43
Gender Male, 52.7%
Sad 45.5%
Calm 45.8%
Angry 46.3%
Fear 45.9%
Happy 47%
Confused 45.1%
Surprised 49.2%
Disgusted 45.2%

AWS Rekognition

Age 23-35
Gender Male, 50.3%
Calm 49.6%
Angry 49.6%
Surprised 49.5%
Confused 49.6%
Disgusted 49.9%
Happy 49.6%
Sad 49.8%
Fear 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Happy 49.5%
Disgusted 49.6%
Calm 49.6%
Sad 49.7%
Surprised 49.5%
Confused 49.7%
Fear 49.5%
Angry 49.9%

AWS Rekognition

Age 31-47
Gender Male, 50.5%
Happy 49.6%
Confused 49.5%
Calm 49.6%
Fear 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 50.3%
Sad 49.5%

AWS Rekognition

Age 42-60
Gender Male, 50.5%
Happy 49.8%
Sad 49.7%
Disgusted 49.5%
Fear 49.5%
Calm 49.7%
Angry 49.6%
Confused 49.6%
Surprised 49.6%

AWS Rekognition

Age 36-54
Gender Male, 54.8%
Fear 45.7%
Happy 45%
Calm 46.5%
Sad 52.2%
Angry 45.1%
Surprised 45.1%
Disgusted 45%
Confused 45.4%

AWS Rekognition

Age 16-28
Gender Female, 50.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%
Calm 49.6%
Happy 50.1%
Angry 49.7%
Fear 49.5%
Disgusted 49.5%

AWS Rekognition

Age 36-52
Gender Male, 54.9%
Happy 45.7%
Angry 45.4%
Disgusted 45.1%
Surprised 45.1%
Calm 53.6%
Sad 45.1%
Fear 45%
Confused 45.1%

AWS Rekognition

Age 41-59
Gender Male, 50.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Calm 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.5%
Surprised 49.5%

AWS Rekognition

Age 46-64
Gender Male, 52.7%
Surprised 45%
Fear 45%
Angry 45%
Disgusted 45%
Sad 45%
Calm 45.1%
Happy 54.9%
Confused 45%

AWS Rekognition

Age 5-15
Gender Male, 50.5%
Confused 49.7%
Surprised 49.7%
Sad 49.6%
Calm 49.9%
Disgusted 49.6%
Happy 49.5%
Fear 49.5%
Angry 49.6%

AWS Rekognition

Age 27-43
Gender Female, 50.3%
Happy 49.5%
Fear 49.6%
Sad 49.6%
Confused 49.5%
Disgusted 49.5%
Angry 49.6%
Calm 49.9%
Surprised 49.6%

AWS Rekognition

Age 36-52
Gender Male, 50.1%
Fear 49.8%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Sad 50.2%
Calm 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 37-55
Gender Male, 50.5%
Fear 49.6%
Sad 49.6%
Happy 49.7%
Calm 49.6%
Angry 49.8%
Surprised 49.6%
Disgusted 49.6%
Confused 49.6%

AWS Rekognition

Age 26-40
Gender Male, 50.5%
Angry 50.1%
Happy 49.5%
Disgusted 49.5%
Calm 49.5%
Fear 49.6%
Surprised 49.5%
Sad 49.8%
Confused 49.5%

AWS Rekognition

Age 30-46
Gender Male, 50.4%
Disgusted 49.5%
Happy 50.4%
Confused 49.5%
Angry 49.5%
Fear 49.6%
Sad 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.5%
Angry 49.5%
Happy 49.6%
Disgusted 49.5%
Fear 49.5%
Confused 49.5%
Surprised 49.5%
Calm 50.3%
Sad 49.6%

AWS Rekognition

Age 38-56
Gender Male, 50.3%
Happy 49.5%
Angry 49.6%
Confused 49.5%
Calm 49.7%
Disgusted 49.5%
Fear 49.6%
Surprised 50.1%
Sad 49.5%

AWS Rekognition

Age 10-20
Gender Female, 53.2%
Angry 45.1%
Happy 45.1%
Disgusted 45%
Confused 45.1%
Surprised 45.1%
Calm 53%
Fear 45.1%
Sad 46.6%

AWS Rekognition

Age 19-31
Gender Female, 50.1%
Happy 49.5%
Disgusted 49.5%
Sad 49.5%
Angry 49.8%
Surprised 49.8%
Fear 49.8%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 24-38
Gender Male, 50.4%
Disgusted 49.5%
Sad 50.3%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Fear 49.6%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 23-37
Gender Female, 50.3%
Calm 45.2%
Angry 45.2%
Surprised 46.6%
Confused 46%
Disgusted 45.9%
Happy 46.1%
Sad 47%
Fear 48.1%

Feature analysis

Amazon

Person 99.5%

Categories

Imagga

paintings art 91.3%
people portraits 6.9%

Text analysis

Amazon

th 3 3 2s1

Google

'st 3 a 2 t
'st
3
a
2
t