Human Generated Data

Title

Untitled (people in old-fashioned clothes on city street)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16066

Human Generated Data

Title

Untitled (people in old-fashioned clothes on city street)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 99.7
Human 99.7
Person 99.4
Apparel 99.3
Clothing 99.3
Person 99.2
Person 99.1
Person 99
Person 99
Person 98.9
Person 98.4
Person 98.3
Person 98.3
Person 98.2
Overcoat 97.8
Coat 97.8
Person 94.6
Person 91.2
Person 91
Person 87.2
Face 76
Tuxedo 72.9
Shop 71.3
Market 71.3
Bazaar 71.3
People 69.4
Person 66.2
Advertisement 63.9
Suit 63.4
Text 61.6
Poster 61.2
Fashion 55.1
Gown 55.1
Robe 55.1
Evening Dress 55.1

Imagga
created on 2022-03-25

kin 67.9
home 30.3
couple 27
man 26.9
people 26.2
happy 23.8
mother 23.2
adult 21.6
person 21.5
male 21.4
family 21.4
love 21.3
portrait 20.7
father 20.4
child 19.9
sitting 19.8
smiling 19.5
dad 18.8
happiness 18
men 17.2
parent 16.8
daughter 15.7
smile 15.7
couch 14.5
senior 14.1
women 13.4
house 13.4
together 13.1
lifestyle 13
room 13
passenger 12.2
two 11.9
loving 11.4
indoors 11.4
cheerful 11.4
old 11.1
girls 10.9
groom 10.7
fun 10.5
indoor 10
living room 9.8
black 9.6
married 9.6
sofa 9.6
togetherness 9.4
holiday 9.3
window 9.3
dress 9
bride 8.9
interior 8.8
affectionate 8.7
affection 8.7
day 8.6
talking 8.6
face 8.5
females 8.5
youth 8.5
summer 8.4
fashion 8.3
romantic 8
kiss 7.8
patient 7.8
attractive 7.7
pretty 7.7
30s 7.7
elderly 7.7
husband 7.6
baby 7.6
relaxed 7.5
relationship 7.5
mature 7.4
holding 7.4
care 7.4
wedding 7.4
lady 7.3
children 7.3
group 7.3
computer 7.2
sexy 7.2
celebration 7.2
businessman 7.1

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

person 98.5
clothing 98
man 94.8
text 88.2
group 87.6
window 85
people 75.8
woman 75.3
black and white 74.6
footwear 73.4
posing 44.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-53
Gender Female, 99.9%
Calm 99%
Disgusted 0.3%
Angry 0.2%
Sad 0.2%
Confused 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 58-66
Gender Male, 85.9%
Calm 98.3%
Sad 0.8%
Fear 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Female, 79.2%
Calm 95.4%
Fear 3.6%
Sad 0.3%
Happy 0.2%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 65-75
Gender Female, 88.3%
Sad 51.2%
Calm 40%
Confused 3.2%
Angry 2.8%
Disgusted 1.1%
Fear 0.8%
Surprised 0.5%
Happy 0.5%

AWS Rekognition

Age 57-65
Gender Male, 98.1%
Calm 84.8%
Happy 10.3%
Fear 1.5%
Angry 1.1%
Sad 1%
Confused 0.9%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 49-57
Gender Male, 98.2%
Sad 57.2%
Angry 16.3%
Calm 11%
Disgusted 4.5%
Confused 4.2%
Fear 3.5%
Surprised 2.1%
Happy 1.2%

AWS Rekognition

Age 54-62
Gender Female, 97.3%
Happy 99.8%
Calm 0.1%
Surprised 0%
Sad 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 53-61
Gender Male, 88.3%
Calm 38.3%
Sad 19.9%
Disgusted 15.8%
Fear 12.2%
Angry 5.7%
Confused 3.9%
Happy 2.3%
Surprised 1.9%

AWS Rekognition

Age 38-46
Gender Male, 90.5%
Calm 23.5%
Sad 20.3%
Confused 19%
Angry 12.6%
Fear 9.5%
Surprised 8.9%
Disgusted 3.9%
Happy 2.2%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Happy 56.4%
Calm 31.5%
Sad 6.7%
Angry 2.2%
Fear 1.1%
Surprised 0.9%
Confused 0.8%
Disgusted 0.3%

AWS Rekognition

Age 54-62
Gender Male, 76.2%
Calm 62.2%
Sad 30.6%
Confused 2%
Angry 1.5%
Disgusted 1.1%
Fear 1.1%
Surprised 0.8%
Happy 0.7%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Calm 59.2%
Disgusted 25.4%
Sad 12%
Fear 1.2%
Confused 0.7%
Happy 0.6%
Angry 0.5%
Surprised 0.3%

AWS Rekognition

Age 25-35
Gender Female, 91.3%
Happy 65.5%
Calm 13.7%
Sad 7.3%
Confused 5.1%
Disgusted 2.8%
Fear 2.2%
Angry 1.9%
Surprised 1.6%

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%
Suit 63.4%

Captions

Microsoft

a group of people sitting posing for the camera 95.9%
a group of people sitting in front of a window 90.1%
a group of people sitting in front of a crowd posing for the camera 90%

Text analysis

Amazon

BANK
KS
NON
NON INDIANCE
44210
INDIANCE

Google

BANK
BANK BANK