Human Generated Data

Title

Untitled (women's group, some wearing hats)

Date

1974

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19798

Human Generated Data

Title

Untitled (women's group, some wearing hats)

People

Artist: Ken Whitmire Associates, American

Date

1974

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.8
Human 99.8
Clothing 99.8
Apparel 99.8
Person 99.7
Person 99.7
Person 99.6
Person 99.6
Shorts 99.5
Person 98.9
Person 98.8
Person 98.7
Person 97.9
Person 97.3
Person 97.1
Sunglasses 96.4
Accessories 96.4
Accessory 96.4
Sunglasses 94.8
Person 94.6
Person 92.5
Chair 92.4
Furniture 92.4
Face 90.8
Female 86
Outdoors 84.8
Glasses 84.7
Nature 84.6
Sunglasses 82.1
Sunglasses 75.5
People 74.6
Coat 73.7
Suit 73.7
Overcoat 73.7
Sunglasses 72.6
Sunglasses 72.4
Sunglasses 68.9
Goggles 68.4
Sunglasses 67.7
Sunglasses 67.7
Woman 67.5
Portrait 64.6
Photography 64.6
Photo 64.6
Crowd 63.9
Girl 63.1
Hat 61.5
Vacation 61.2
Dress 59.3
Shirt 58.1
Person 58
Military Uniform 55.6
Military 55.6

Imagga
created on 2022-03-05

people 32.9
person 27.5
happy 24.4
couple 24.4
man 24.2
male 23.4
spectator 20.1
women 19.7
group 19.3
together 18.4
happiness 18
adult 17.2
men 17.2
groom 16.7
smiling 16.6
world 16.1
bride 15.3
love 15
friends 14.1
lifestyle 13.7
portrait 13.6
wedding 12.9
dress 12.6
marriage 12.3
two 11.8
old 11.8
married 11.5
enjoying 11.4
day 11
pretty 10.5
fun 10.5
bouquet 10.4
friendship 10.3
clothing 10.2
joy 10
attractive 9.8
art 9.8
human 9.7
flowers 9.6
work 9.4
senior 9.4
outdoors 9.2
supporter 9.2
life 9
team 8.9
cheerful 8.9
family 8.9
mother 8.8
indoors 8.8
talking 8.5
business 8.5
active 8.4
outdoor 8.4
summer 8.3
drink 8.3
leisure 8.3
park 8.2
romance 8
sexy 8
water 8
home 8
businessman 7.9
husband 7.9
half length 7.8
party 7.7
sitting 7.7
drinking 7.6
silhouette 7.4
camera 7.4
teen 7.3
office 7.2
hair 7.1
smile 7.1
face 7.1

Google
created on 2022-03-05

Shorts 89.2
Hat 86.4
Style 83.8
Smile 82.9
Headgear 80.9
Adaptation 79.4
Vintage clothing 75.6
Art 73.9
Crew 73.5
Team 72.7
Monochrome 71.7
Event 69.1
History 68.5
Stock photography 63.6
Room 62.5
Uniform 62.3
Fun 59.8
Monochrome photography 59.5
Photo caption 57.5
Crowd 56.7

Microsoft
created on 2022-03-05

person 98.6
text 94.5
clothing 90.8
standing 77.9
posing 71.6
group 66.2
smile 64.6
man 61.6
human face 56.6
people 56.2
woman 51.1

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Female, 98.8%
Happy 66.1%
Calm 32.7%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%
Angry 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99%
Happy 69.1%
Sad 11.3%
Disgusted 4.8%
Fear 4.7%
Surprised 4%
Confused 2.5%
Angry 1.8%
Calm 1.8%

AWS Rekognition

Age 45-53
Gender Female, 95.2%
Calm 58.2%
Sad 27.4%
Happy 10.9%
Fear 1.8%
Surprised 0.6%
Confused 0.5%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 51-59
Gender Male, 98.9%
Calm 92.7%
Happy 5.1%
Sad 0.6%
Surprised 0.6%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Calm 94%
Happy 3.5%
Sad 1.1%
Surprised 0.4%
Fear 0.4%
Disgusted 0.3%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 53-61
Gender Female, 99.9%
Happy 96.8%
Calm 2.7%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 51-59
Gender Male, 98.8%
Calm 66.9%
Sad 16.6%
Confused 6.4%
Fear 3%
Surprised 2.5%
Happy 1.8%
Disgusted 1.6%
Angry 1.1%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 95.8%
Happy 3.8%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 53-61
Gender Female, 65.8%
Calm 85.7%
Happy 12.2%
Confused 0.8%
Sad 0.6%
Disgusted 0.3%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Female, 99.6%
Happy 98.8%
Calm 1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Sad 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 48-56
Gender Male, 98.6%
Calm 99.4%
Happy 0.6%
Confused 0%
Disgusted 0%
Surprised 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 83.3%
Happy 47.5%
Sad 27.9%
Calm 13.4%
Surprised 5.9%
Confused 2.1%
Disgusted 1.8%
Angry 0.9%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Sunglasses 96.4%

Captions

Microsoft

a group of people posing for a photo 96.9%
a group of people posing for the camera 96.8%
a group of people posing for a picture 96.7%

Text analysis

Amazon

AUX
DAX
BAX
DAY
AUX.
AND

Google

peer
peer