Human Generated Data

Title

Untitled (proof print: family portrait of 20 gathered in living room)

Date

1950s

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14110

Human Generated Data

Title

Untitled (proof print: family portrait of 20 gathered in living room)

People

Artist: Martin Schweig, American 20th century

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.2
Person 99.2
Person 99
Person 98.8
Person 98.7
Person 97.8
Person 97.6
Tie 97.5
Accessory 97.5
Accessories 97.5
Person 97.1
Person 96.9
People 96.7
Person 96.5
Person 96
Person 95.4
Person 94.1
Person 93.7
Person 92.5
Tie 86.6
Family 83.4
Person 80.6
Person 78.9
Person 78.3
Coat 74.1
Clothing 74.1
Overcoat 74.1
Apparel 74.1
Suit 74.1
Person 69.1
Advertisement 65.3
Poster 65.3
Suit 63.2
Room 60.2
Indoors 60.2
School 56.2
Person 42.8

Imagga
created on 2022-01-22

kin 100
people 27.9
man 26.9
person 24.2
male 22.7
adult 22.5
portrait 18.8
group 18.5
family 16.9
happy 15.7
black 15
child 14.3
couple 13.9
youth 13.6
world 13.5
love 13.4
room 12.9
silhouette 12.4
businessman 12.3
boy 12.2
classroom 12.1
fun 12
attractive 11.9
smiling 11.6
business 11.5
face 11.4
men 11.2
happiness 10.2
smile 10
mother 10
active 9.9
fashion 9.8
pretty 9.8
sexy 9.6
home 9.6
friends 9.4
teacher 9.1
team 9
sport 8.9
interior 8.8
brunette 8.7
women 8.7
education 8.7
leisure 8.3
clothing 8.3
human 8.2
one 8.2
girls 8.2
professional 8.1
success 8
kid 8
party 7.7
bride 7.7
two 7.6
friendship 7.5
style 7.4
wedding 7.4
cheerful 7.3
daughter 7.3
office 7.2
dress 7.2
lifestyle 7.2
cute 7.2
night 7.1
planner 7.1
student 7

Google
created on 2022-01-22

Font 81
Suit 79.2
People 77.8
Vintage clothing 73.9
Team 73.6
Event 73.2
Crew 72.6
Family reunion 72
History 66.4
Room 65.1
Stock photography 63.7
Classic 63.5
Art 62.3
Child 58.7
Monochrome 57.8
Retro style 55.4
Handwriting 54
Family 53.1
Photo caption 52.9
Collection 50.3

Microsoft
created on 2022-01-22

text 99.8
posing 99.1
person 97.8
clothing 97.6
indoor 93.3
smile 87.3
man 80.9
old 80.3
group 80
human face 58.7
school 53.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Female, 76.3%
Happy 93.1%
Calm 5.3%
Angry 0.8%
Surprised 0.3%
Confused 0.3%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Happy 89.1%
Calm 4.4%
Surprised 3.5%
Angry 1.4%
Confused 0.6%
Fear 0.5%
Sad 0.4%
Disgusted 0.2%

AWS Rekognition

Age 1-7
Gender Female, 100%
Happy 87.9%
Calm 10.3%
Surprised 0.6%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 33-41
Gender Female, 100%
Calm 44%
Angry 17.8%
Happy 17.4%
Surprised 10.6%
Confused 4.6%
Fear 2.3%
Sad 2.2%
Disgusted 1%

AWS Rekognition

Age 4-10
Gender Male, 99.5%
Calm 98.8%
Confused 0.5%
Surprised 0.2%
Happy 0.2%
Sad 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 2-10
Gender Female, 93.7%
Calm 99.7%
Confused 0.1%
Sad 0.1%
Surprised 0%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 98.3%
Calm 98.4%
Angry 0.4%
Surprised 0.3%
Happy 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 79.1%
Happy 14.9%
Confused 2.2%
Angry 1.2%
Disgusted 1.1%
Sad 0.6%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Happy 92.4%
Calm 4.3%
Sad 1.1%
Angry 0.6%
Fear 0.5%
Surprised 0.5%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 34-42
Gender Female, 99.9%
Happy 96.8%
Surprised 1.4%
Fear 0.7%
Angry 0.3%
Confused 0.3%
Sad 0.2%
Calm 0.2%
Disgusted 0.1%

AWS Rekognition

Age 11-19
Gender Male, 99.9%
Calm 52.3%
Surprised 18.5%
Happy 9.3%
Confused 8.1%
Fear 4.1%
Angry 3.9%
Sad 2.8%
Disgusted 0.9%

AWS Rekognition

Age 6-14
Gender Male, 99.9%
Happy 96%
Calm 2.1%
Confused 0.6%
Surprised 0.4%
Angry 0.3%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 98.4%
Confused 0.4%
Angry 0.3%
Happy 0.3%
Surprised 0.3%
Fear 0.2%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 59-67
Gender Female, 99.8%
Calm 94%
Angry 2.5%
Disgusted 0.9%
Fear 0.6%
Happy 0.6%
Surprised 0.5%
Confused 0.5%
Sad 0.4%

AWS Rekognition

Age 33-41
Gender Female, 100%
Calm 99.3%
Happy 0.2%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 95.1%
Sad 3%
Angry 0.9%
Surprised 0.4%
Confused 0.2%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Happy 52.8%
Calm 42.9%
Confused 1.1%
Surprised 1%
Fear 0.7%
Angry 0.5%
Sad 0.5%
Disgusted 0.5%

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Calm 99.6%
Surprised 0.2%
Angry 0.1%
Sad 0%
Confused 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 99%
Happy 78.3%
Calm 20.6%
Surprised 0.3%
Confused 0.2%
Angry 0.2%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 0-3
Gender Female, 77%
Calm 44.8%
Fear 35.1%
Surprised 16.7%
Angry 0.9%
Happy 0.9%
Sad 0.7%
Disgusted 0.6%
Confused 0.4%

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 97.5%
Suit 74.1%
Poster 65.3%

Captions

Microsoft

a group of people posing for a photo 97.7%
a group of people posing for the camera 97.6%
a group of people posing for a picture 97.5%

Text analysis

Amazon

this
PROOF
5
SAINT
MARTIN
SAINT LOUIS
MARTIN SCHWEIG
LOUIS
SCHWEIG
of
make 5 copies of this proof.
proof.
make
cho
copies
is
10s cho is > Tourthey
10s
>
Tourthey

Google

huey,
SAINT
MARTIN
proof.
PROOF
Make
f
this
o huey, Moloney PROOF MARTIN SCHWEIG SAINT LOUIS Make SCapies f this proof.
o
Moloney
SCHWEIG
LOUIS
SCapies