Human Generated Data

Title

Untitled (four men and six women in formal wear, studio group portrait)
Date

c. 1940
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1505

Human Generated Data

Title

Untitled (four men and six women in formal wear, studio group portrait)

People

Artist: John Deusing, American active 1940s

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.9
Apparel 99.9
Person 99.7
Human 99.7
Person 99.7
Person 99.6
Person 99.5
Person 99.5
Person 99.5
Person 99.2
Person 99.2
Person 99
Person 99
Shorts 98.7
Female 94.4
Skirt 91.3
Dress 90.5
Face 83.6
People 83.2
Woman 82.2
Suit 79.7
Overcoat 79.7
Coat 79.7
Girl 62.9
Portrait 62.5
Photography 62.5
Photo 62.5
Tartan 60.3
Plaid 60.3
Outdoors 59
Grass 56.8
Plant 56.8

Imagga
created on 2021-12-14

kin 100
couple 34.8
man 32.9
people 28.4
groom 25
love 23.7
male 22.8
happiness 22.7
silhouette 19.9
sunset 19.8
person 17.7
bride 17.6
happy 16.9
outdoors 16.4
two 16.1
wedding 15.6
adult 15.3
family 15.1
men 14.6
romance 14.3
together 14
outdoor 13
summer 12.9
sky 12.7
romantic 12.5
holding 12.4
portrait 12.3
relationship 12.2
group 12.1
youth 11.9
dress 11.7
active 11.7
smiling 11.6
park 11.5
married 11.5
black 11.4
walking 11.4
brass 11.3
fun 11.2
wind instrument 11
beach 11
lifestyle 10.8
child 10.7
marriage 10.4
bouquet 10.4
life 10.3
friendship 10.3
women 10.3
musical instrument 9.8
businessman 9.7
celebration 9.6
boy 9.6
husband 9.5
walk 9.5
evening 9.3
joy 9.2
wed 8.8
wife 8.5
attractive 8.4
future 8.4
leisure 8.3
human 8.2
world 8.1
sun 8
business 7.9
holiday 7.9
day 7.8
smile 7.8
party 7.7
sport 7.7
enjoying 7.6
pair 7.6
vacation 7.4
mother 7.3

Google
created on 2021-12-14

Style 83.8
Vintage clothing 75
Snapshot 74.3
Monochrome 73.1
Monochrome photography 71.7
Crew 71
Event 69.1
Uniform 68.9
Suit 67.5
History 66.8
Ball 66.5
Team 66.3
Picture frame 65.9
Stock photography 65.1
Sports equipment 57.5
Photo caption 56
Room 54.9
Visual arts 53.5
Family taking photos together 52.7
Family 52.7

Microsoft
created on 2021-12-14

posing 99
text 98.8
person 98.7
window 98.3
clothing 95.3
man 92.2
standing 90.2
old 89.5
group 74.7
team 42.2

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 97.8%
Surprised 73.8%
Calm 20.6%
Confused 3.6%
Happy 0.9%
Angry 0.5%
Sad 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 62.6%
Calm 97%
Surprised 2%
Happy 0.4%
Sad 0.3%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 16-28
Gender Male, 74.1%
Calm 87.2%
Surprised 4.8%
Happy 3.3%
Fear 2.4%
Confused 0.9%
Sad 0.8%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-37
Gender Male, 92.5%
Calm 64.5%
Sad 25.1%
Happy 3%
Confused 2.4%
Surprised 2.2%
Fear 1.9%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 16-28
Gender Male, 77%
Surprised 51.9%
Fear 21.2%
Calm 14.9%
Happy 7.7%
Angry 1.6%
Confused 1.4%
Sad 0.8%
Disgusted 0.4%

AWS Rekognition

Age 23-37
Gender Male, 78.9%
Calm 66.1%
Happy 13.2%
Surprised 12.1%
Fear 5%
Sad 1.5%
Angry 0.9%
Confused 0.8%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Male, 89.8%
Calm 91.3%
Surprised 3.5%
Happy 2%
Sad 1.5%
Confused 0.9%
Fear 0.3%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 21-33
Gender Male, 90.4%
Calm 89%
Happy 6.1%
Sad 2.6%
Surprised 1.1%
Confused 0.8%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-30
Gender Male, 89.6%
Calm 79.5%
Surprised 12.1%
Sad 2.3%
Angry 2.3%
Fear 1.5%
Happy 1%
Confused 1%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Male, 91.3%
Calm 92.9%
Surprised 2.3%
Sad 2.1%
Happy 1.1%
Angry 0.7%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 97.1%
an old photo of a group of people posing for the camera 96.3%
an old photo of a group of people posing for a picture 96.2%