Human Generated Data

Title

Untitled (two photographs: old couple posing with extended family on occasion of golden anniversary; old couple posing with children and grandchildren on occasion of golden anniversary)
Date

1949, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12361

Human Generated Data

Title

Untitled (two photographs: old couple posing with extended family on occasion of golden anniversary; old couple posing with children and grandchildren on occasion of golden anniversary)

People

Artist: Martin Schweig, American 20th century

Date

1949, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12361

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Collage 100
Advertisement 100
Poster 100
Human 99.3
Person 99.3
Person 99.2
Person 99.1
Person 99.1
Person 99.1
Person 98.8
Person 98.5
Person 98.5
Person 98.5
Person 98.4
Person 98.1
Person 98
Person 97.5
Person 97.1
Person 96.7
Person 96.2
Person 95.9
Person 94.4
Person 93.8
Person 93
Person 91.8
Suit 82.4
Coat 82.4
Apparel 82.4
Overcoat 82.4
Clothing 82.4
Person 75.6
Person 74.2
Person 69.6
Person 68.5
Person 68.3
Person 67.5
Suit 64.1
Person 61.8

Clarifai
created on 2019-11-16

people 99.9
many 98.7
adult 98.6
group 97.9
group together 95.5
man 94.9
wear 94.2
woman 93.1
outfit 89.7
administration 89.4
leader 88.5
room 87.3
crowd 82.6
uniform 79.9
war 79.9
indoors 78.9
military 78.4
child 77.3
music 76.3
education 75.1

Imagga
created on 2019-11-16

blackboard 100
man 28.2
people 24.5
male 24.1
person 22.1
classroom 20.3
business 17.6
black 17.4
education 16.4
happy 15.7
old 15.3
room 15.2
portrait 14.9
office 14.4
adult 14
student 13.9
group 13.7
teacher 13
smile 12.8
school 12.6
businessman 12.3
modern 11.9
class 11.6
hand 11.4
college 11.4
vintage 10.7
senior 10.3
smiling 10.1
symbol 10.1
board 9.9
chalkboard 9.8
human 9.7
men 9.4
grunge 9.4
casual 9.3
indoor 9.1
sign 9
teaching 8.8
couple 8.7
money 8.5
art 8.5
friends 8.4
professional 8.4
computer 8
work 7.8
students 7.8
university 7.8
drawing 7.7
desk 7.5
writing 7.5
child 7.5
one 7.5
study 7.5
silhouette 7.4
holding 7.4
glasses 7.4
retro 7.4
guy 7.3
design 7.3
world 7.3
looking 7.2
night 7.1
indoors 7

Google
created on 2019-11-16

Photograph 96.7
Snapshot 85.1
Photography 73.8
Picture frame 73.8
Photograph album 72
Room 71.4
Black-and-white 68.3
Art 67.7
Photographic paper 65.8
Album 62.9
Collection 61.9
Family 55.3
History 54.1

Microsoft
created on 2019-11-16

clothing 97.5
person 96.5
suit 93
text 92.7
man 92.2
standing 89.9
posing 87.5
group 73.2
black 65.9
old 56.3
line 23.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 61-77
Gender Female, 51.1%
Disgusted 45%
Fear 45%
Surprised 45%
Angry 45%
Calm 54.9%
Happy 45%
Confused 45%
Sad 45%

AWS Rekognition

Age 43-61
Gender Male, 54.4%
Fear 45%
Sad 45%
Angry 45%
Calm 46.8%
Confused 45.3%
Disgusted 45.1%
Happy 52.7%
Surprised 45.1%

AWS Rekognition

Age 6-16
Gender Male, 50.5%
Angry 49.5%
Happy 49.5%
Fear 49.5%
Disgusted 49.5%
Sad 50.1%
Calm 49.8%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 46-64
Gender Male, 54.4%
Fear 45.1%
Surprised 45.2%
Confused 45.2%
Sad 45.4%
Disgusted 45.1%
Happy 47.2%
Calm 51.5%
Angry 45.4%

AWS Rekognition

Age 45-63
Gender Male, 54.8%
Calm 46%
Surprised 45.1%
Disgusted 45.3%
Happy 45.1%
Angry 45.2%
Confused 45.4%
Sad 52.8%
Fear 45.1%

AWS Rekognition

Age 70-84
Gender Female, 54.3%
Calm 48.9%
Surprised 46%
Disgusted 45.3%
Happy 46.4%
Angry 46.6%
Confused 45.3%
Sad 46%
Fear 45.4%

AWS Rekognition

Age 34-50
Gender Female, 54.8%
Fear 48.9%
Angry 46.2%
Happy 45%
Disgusted 45.1%
Confused 45.2%
Calm 45.2%
Sad 49.3%
Surprised 45.1%

AWS Rekognition

Age 8-18
Gender Female, 50%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 50.2%
Fear 49.5%
Surprised 49.5%
Confused 49.5%
Sad 49.7%

AWS Rekognition

Age 5-15
Gender Female, 50.2%
Calm 49.7%
Fear 49.6%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 50.1%
Confused 49.5%

AWS Rekognition

Age 43-61
Gender Male, 50.4%
Happy 49.6%
Sad 50.3%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Calm 49.5%
Fear 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50.1%
Fear 49.6%
Calm 49.6%
Disgusted 49.6%
Angry 49.6%
Surprised 49.8%
Happy 49.7%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 2-8
Gender Male, 50.4%
Fear 49.5%
Angry 49.5%
Calm 49.5%
Surprised 49.5%
Happy 49.7%
Confused 49.5%
Sad 50.3%
Disgusted 49.5%

AWS Rekognition

Age 46-64
Gender Male, 50.4%
Fear 49.7%
Disgusted 49.8%
Surprised 49.6%
Sad 49.6%
Happy 49.5%
Confused 49.6%
Angry 49.7%
Calm 49.6%

AWS Rekognition

Age 3-11
Gender Male, 55%
Happy 54.7%
Disgusted 45%
Fear 45%
Calm 45.3%
Confused 45%
Sad 45%
Surprised 45%
Angry 45%

AWS Rekognition

Age 4-14
Gender Male, 50.4%
Angry 49.5%
Calm 49.6%
Happy 49.6%
Sad 50.3%
Fear 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 6-16
Gender Female, 50.4%
Surprised 49.6%
Fear 49.5%
Angry 49.5%
Disgusted 49.5%
Sad 49.5%
Calm 50.2%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 4-14
Gender Female, 54.9%
Fear 45.1%
Confused 45.1%
Happy 45%
Calm 47.2%
Surprised 45%
Sad 52.4%
Angry 45%
Disgusted 45%

AWS Rekognition

Age 65-79
Gender Male, 50.5%
Angry 49.6%
Surprised 49.5%
Disgusted 49.6%
Confused 49.5%
Fear 49.6%
Calm 49.8%
Happy 49.8%
Sad 49.7%

AWS Rekognition

Age 32-48
Gender Female, 53%
Surprised 45.2%
Fear 45.1%
Disgusted 45.2%
Calm 45.1%
Angry 45.4%
Confused 45.1%
Happy 53.5%
Sad 45.3%

AWS Rekognition

Age 1-5
Gender Male, 53.3%
Angry 45%
Surprised 45.2%
Sad 45.7%
Happy 45%
Calm 53.4%
Fear 45.5%
Confused 45.1%
Disgusted 45%

AWS Rekognition

Age 27-43
Gender Female, 50%
Calm 49.5%
Disgusted 49.5%
Surprised 49.9%
Fear 49.7%
Happy 49.5%
Angry 49.5%
Confused 49.6%
Sad 49.8%

AWS Rekognition

Age 24-38
Gender Male, 50.5%
Sad 50.5%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 38-56
Gender Male, 54.9%
Angry 45.1%
Fear 45.1%
Disgusted 45.2%
Sad 47.7%
Confused 45.1%
Calm 45.4%
Happy 51.3%
Surprised 45%

AWS Rekognition

Age 28-44
Gender Female, 54.7%
Surprised 46.4%
Angry 46.1%
Fear 46.2%
Calm 45.9%
Confused 45.9%
Sad 47.2%
Disgusted 45.5%
Happy 46.9%

AWS Rekognition

Age 47-65
Gender Male, 50.1%
Disgusted 49.8%
Happy 49.7%
Angry 49.5%
Fear 49.5%
Calm 49.7%
Sad 49.7%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 27-43
Gender Female, 54.8%
Sad 45.3%
Fear 46.7%
Angry 47.5%
Surprised 46.1%
Calm 45.5%
Disgusted 46%
Confused 45.5%
Happy 47.3%

AWS Rekognition

Age 6-16
Gender Female, 50.5%
Disgusted 49.5%
Sad 49.7%
Fear 49.6%
Angry 49.9%
Confused 49.5%
Happy 49.5%
Calm 49.8%
Surprised 49.5%

AWS Rekognition

Age 4-14
Gender Female, 50.4%
Happy 49.5%
Confused 49.5%
Calm 50.1%
Angry 49.5%
Fear 49.6%
Disgusted 49.5%
Sad 49.8%
Surprised 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Sad 49.6%
Angry 49.6%
Happy 49.7%
Calm 49.5%
Fear 49.7%
Disgusted 49.5%
Confused 49.6%
Surprised 49.7%

AWS Rekognition

Age 3-9
Gender Male, 50.4%
Happy 49.5%
Fear 49.8%
Angry 50.2%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 49.5%
Sad 49.5%

AWS Rekognition

Age 41-59
Gender Male, 53.3%
Calm 51%
Fear 45.1%
Angry 45.4%
Disgusted 45.6%
Sad 45.8%
Happy 46.9%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 36-54
Gender Female, 54.7%
Angry 45.6%
Happy 49.7%
Disgusted 45.5%
Calm 45.8%
Fear 45.2%
Surprised 45.3%
Sad 47.3%
Confused 45.5%

AWS Rekognition

Age 38-56
Gender Female, 50.4%
Calm 49.5%
Fear 49.6%
Confused 49.5%
Happy 50%
Angry 49.7%
Disgusted 49.6%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 35-51
Gender Female, 50.2%
Angry 49.5%
Sad 50.4%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.5%

AWS Rekognition

Age 44-62
Gender Male, 50.4%
Calm 49.8%
Angry 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.1%
Fear 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.2%
Fear 49.6%
Happy 49.6%
Calm 49.6%
Surprised 49.5%
Disgusted 49.5%
Angry 49.6%
Sad 50%
Confused 49.6%

AWS Rekognition

Age 24-38
Gender Male, 54.9%
Happy 52.9%
Angry 45.3%
Confused 45.4%
Calm 45.4%
Disgusted 45.5%
Fear 45.2%
Surprised 45.2%
Sad 45.2%

AWS Rekognition

Age 1-5
Gender Male, 50.2%
Disgusted 49.5%
Calm 49.9%
Surprised 49.5%
Fear 49.5%
Happy 49.6%
Confused 49.5%
Sad 50%
Angry 49.5%

AWS Rekognition

Age 57-75
Gender Female, 54.6%
Fear 45.4%
Surprised 45.3%
Confused 45.3%
Sad 45.7%
Disgusted 45.3%
Happy 51.7%
Calm 45.6%
Angry 45.6%

AWS Rekognition

Age 38-56
Gender Male, 50.5%
Calm 49.5%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 50.4%
Angry 49.5%
Confused 49.5%
Sad 49.5%

AWS Rekognition

Age 22-34
Gender Male, 54.5%
Disgusted 45%
Calm 45%
Angry 45.1%
Confused 45%
Fear 45%
Sad 45.1%
Surprised 45%
Happy 54.7%

AWS Rekognition

Age 46-64
Gender Male, 54.7%
Angry 45.3%
Calm 46.1%
Sad 51.1%
Happy 45.3%
Fear 45.2%
Confused 45.7%
Surprised 45.2%
Disgusted 46.1%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 67
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Suit 82.4%

Categories

Imagga

text visuals 46.5%
paintings art 43.9%
streetview architecture 4.7%
interior objects 2.9%

Text analysis

Amazon

rh3752
th
teorreope

Google

ק S 2 רtt יב רth
ק
S
2
רtt
יב
רth