Human Generated Data

Title

[Formal group photo, Heidelberg]
Date

unknown
People

Artist: Lyonel Feininger, American 1871 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.401.4
Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Formal group photo, Heidelberg]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

unknown

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-05

Human 99
Person 99
Person 99
Person 99
Person 98.5
Clothing 97.4
Apparel 97.4
Person 97
Person 96.6
Person 88.6
People 87.9
Person 78.6
Person 76.1
Female 70.8
Face 64.6
Suit 63.7
Overcoat 63.7
Coat 63.7
Portrait 62.2
Photography 62.2
Photo 62.2
Stage 61.6
Girl 59.8
Family 58.2
Sleeve 57
Fashion 55.6
Robe 55.6

Clarifai
created on 2021-04-05

people 99.9
many 98.6
group together 98.4
group 98.2
adult 97.9
woman 96.3
wear 95.4
man 94.9
leader 91.5
several 89.6
outfit 88.8
dancing 88.4
uniform 86.5
dancer 84.9
discipline 84.8
child 83.6
position 83.3
education 81.9
five 81.5
boxer 79.9

Imagga
created on 2021-04-05

person 29.3
nurse 27.5
people 23.4
dress 17.1
adult 17
groom 16.5
man 15.4
male 13.5
men 12.9
old 11.8
love 11.8
couple 11.3
fashion 11.3
dancer 11.2
celebration 11.1
church 11.1
clothing 10.8
religion 10.7
performer 10.7
happy 10.6
life 10.6
fan 10.6
bride 10.5
portrait 10.3
art 10
world 9.8
black 9.6
women 9.5
wall 9.4
happiness 9.4
tourism 9.1
human 9
holy 8.7
faith 8.6
holiday 8.6
follower 8.6
model 8.5
winter 8.5
two 8.5
monument 8.4
attractive 8.4
building 8.3
wedding 8.3
tourist 8.2
group 8.1
history 8
looking 8
night 8
room 8
businessman 7.9
together 7.9
scene 7.8
color 7.8
travel 7.7
catholic 7.6
uniform 7.5
religious 7.5
traditional 7.5
tradition 7.4
light 7.3
business 7.3
entertainer 7.3
student 7.2
home 7.2
romantic 7.1

Google
created on 2021-04-05

Dress 88.5
Black-and-white 84.4
Style 83.9
Monochrome 77.7
Monochrome photography 76.1
Vintage clothing 74.2
Suit 73.7
Event 71.7
Crew 68.1
Curtain 68
Fun 67.6
Formal wear 67.5
Classic 66.1
Uniform 64.4
Room 64.3
History 64
Team 62.8
Fashion design 61
Family 53.4
Retro style 52.9

Microsoft
created on 2021-04-05

person 95.8
wall 95.1
clothing 94.9
wedding dress 90.9
woman 88.4
old 82.8
bride 81.2
dress 76.4
man 75.2
white 65.4

Face analysis

Amazon

Google

AWS Rekognition

Age 38-56
Gender Male, 61.7%
Calm 84.5%
Surprised 7.3%
Happy 2.6%
Fear 1.4%
Angry 1.3%
Confused 1.1%
Sad 1%
Disgusted 0.8%

AWS Rekognition

Age 31-47
Gender Male, 90.2%
Calm 99.1%
Surprised 0.2%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 46-64
Gender Female, 74.5%
Calm 82.1%
Sad 10.6%
Angry 2.8%
Happy 2.3%
Confused 1.1%
Surprised 0.5%
Fear 0.5%
Disgusted 0.2%

AWS Rekognition

Age 25-39
Gender Male, 90.2%
Calm 50.8%
Surprised 21.2%
Confused 12.1%
Happy 8.4%
Angry 3.1%
Fear 2%
Sad 1.5%
Disgusted 0.9%

AWS Rekognition

Age 39-57
Gender Male, 96.4%
Calm 98.4%
Sad 0.6%
Happy 0.6%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 37-55
Gender Female, 56.3%
Calm 61.9%
Sad 32.1%
Surprised 1.9%
Fear 1.6%
Confused 1.2%
Angry 0.7%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 57-75
Gender Female, 74.3%
Calm 52.2%
Surprised 24.4%
Fear 8.9%
Happy 8.3%
Sad 2.5%
Confused 1.7%
Angry 1.3%
Disgusted 0.8%

AWS Rekognition

Age 31-47
Gender Female, 61%
Sad 77.5%
Calm 11.1%
Angry 4.1%
Happy 2.1%
Fear 2%
Surprised 1.4%
Confused 1.3%
Disgusted 0.6%

AWS Rekognition

Age 44-62
Gender Female, 70.7%
Happy 42.7%
Calm 30.9%
Fear 15.1%
Surprised 4.2%
Sad 4%
Angry 2.1%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 23-35
Gender Male, 52.6%
Fear 77.3%
Surprised 6.8%
Calm 4.9%
Sad 4.6%
Angry 3%
Happy 2.4%
Confused 0.8%
Disgusted 0.2%

AWS Rekognition

Age 24-38
Gender Female, 50.5%
Sad 54.6%
Fear 17.3%
Calm 10.6%
Angry 6.1%
Happy 5.9%
Surprised 3.8%
Confused 1.2%
Disgusted 0.6%

AWS Rekognition

Age 34-50
Gender Female, 54.5%
Calm 54.1%
Happy 41.9%
Sad 2.2%
Angry 0.5%
Surprised 0.4%
Confused 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-37
Gender Female, 87.7%
Fear 71.8%
Angry 12.2%
Sad 4.8%
Surprised 4.2%
Happy 3%
Calm 2.7%
Confused 0.8%
Disgusted 0.5%

AWS Rekognition

Age 39-57
Gender Male, 61%
Happy 65.1%
Calm 13.5%
Angry 9.8%
Surprised 6.5%
Sad 3%
Confused 0.7%
Fear 0.7%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 85.4%
a vintage photo of a group of people posing for a picture 85.3%
a vintage photo of a group of people standing in a room 85.2%