Human Generated Data

Title

Untitled (children and man in church)

Date

c. 1970

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19814

Human Generated Data

Title

Untitled (children and man in church)

People

Artist: Ken Whitmire Associates, American

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 100
Apparel 100
Human 99.3
Person 99.2
Person 99.1
Plant 98.2
Fashion 98.1
Robe 98.1
Person 97.7
Gown 97.4
Person 97.3
Person 97.2
Wedding 96.9
Flower 96.6
Blossom 96.6
Flower Bouquet 96.2
Flower Arrangement 96.2
Footwear 95.6
Shoe 95.6
Person 95.4
Person 93.9
Shoe 93.7
Wedding Gown 93.5
Bride 93.5
Person 92.1
Person 91.9
Overcoat 90.5
Suit 90.5
Coat 90.5
Dress 89.4
Shoe 87.5
Indoors 84.8
Bridegroom 82.2
Person 78.4
Female 69.1
Accessories 67.2
Tie 67.2
Accessory 67.2
Lighting 59.9
Tuxedo 59.3
People 59.2
Chair 57
Furniture 57
Face 56.2
Photo 56.2
Portrait 56.2
Photography 56.2
Room 55.8

Imagga
created on 2022-03-05

businessman 38.9
business 38.3
people 37.9
male 36.9
office 34.3
person 34.2
professional 34.1
group 33.9
man 32.3
meeting 32
corporate 31.8
men 29.2
adult 28.8
team 28.7
teacher 28.5
executive 26.1
women 26.1
teamwork 26
job 25.7
happy 25.1
work 24.3
businesswoman 22.7
table 22.5
room 22.2
worker 21
communication 20.2
suit 19
businesspeople 18
modern 17.5
smiling 17.4
success 16.9
manager 16.8
together 16.6
conference 16.6
colleagues 16.5
successful 16.5
smile 15.7
boss 15.3
couple 14.8
educator 14.7
clothing 14.4
talking 14.3
employee 13.7
sitting 13.7
hall 13.6
career 13.3
presentation 13
seminar 12.8
life 12.8
portrait 12.3
desk 12.3
education 12.1
nurse 12.1
attractive 11.9
indoor 11.9
laptop 11.8
ethnic 11.4
indoors 11.4
outfit 11.2
confident 10.9
discussion 10.7
handsome 10.7
building 10.6
new 10.5
formal 10.5
company 10.2
mature 10.2
happiness 10.2
two 10.2
lifestyle 10.1
student 10.1
working 9.7
diversity 9.6
board 9
associates 8.9
interior 8.8
diverse 8.8
looking 8.8
chair 8.5
adults 8.5
casual 8.5
classroom 8.3
training 8.3
computer 8
home 8
color 7.8
partner 7.7
corporation 7.7
leader 7.7
pretty 7.7
partnership 7.7
gown 7.7
finance 7.6
plan 7.6
human 7.5
cheerful 7.3
family 7.1
spectator 7.1
day 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

clothing 94.2
person 93.4
woman 89.1
dress 82.9
standing 81.8
text 77.6
wedding dress 65.4
people 65.2
flower 60.5
wedding 55
posing 41.7

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 92.6%
Sad 58.8%
Confused 28%
Happy 3.6%
Surprised 2.9%
Disgusted 2.5%
Calm 2.1%
Angry 1.4%
Fear 0.8%

AWS Rekognition

Age 35-43
Gender Male, 96.8%
Sad 84.1%
Confused 9.1%
Calm 3.5%
Disgusted 1.1%
Happy 1.1%
Angry 0.5%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Disgusted 24.4%
Angry 21.5%
Calm 15%
Sad 11.2%
Fear 10.8%
Happy 8.2%
Surprised 5.8%
Confused 3.1%

AWS Rekognition

Age 25-35
Gender Female, 89.7%
Calm 90%
Happy 2.3%
Sad 2.1%
Confused 1.8%
Disgusted 1.4%
Angry 1%
Fear 0.9%
Surprised 0.6%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Sad 40.5%
Calm 36.8%
Happy 9.5%
Confused 5.3%
Fear 2.6%
Disgusted 2.5%
Angry 2%
Surprised 0.9%

AWS Rekognition

Age 30-40
Gender Male, 100%
Sad 55.2%
Calm 26.9%
Confused 10.1%
Fear 3.2%
Surprised 1.8%
Disgusted 1.2%
Angry 1.1%
Happy 0.4%

AWS Rekognition

Age 23-33
Gender Female, 58.3%
Calm 62.1%
Sad 15.3%
Disgusted 11%
Surprised 3.4%
Fear 2.9%
Angry 1.9%
Happy 1.9%
Confused 1.5%

AWS Rekognition

Age 48-56
Gender Male, 84.5%
Happy 96.1%
Calm 2.2%
Angry 1.1%
Sad 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Male, 98.5%
Fear 40.7%
Calm 20.6%
Sad 11.9%
Happy 11.6%
Disgusted 7.7%
Angry 3.5%
Surprised 3.2%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Shoe 95.6%
Tie 67.2%

Captions

Microsoft

a group of people standing in front of a building 96.5%
a group of people standing in front of a crowd posing for the camera 92.9%
a group of people standing in front of a crowd 92.8%

Text analysis

Amazon

it