Human Generated Data

Title

Untitled (tossing the bouquet, Brookline, Massachusetts)

Date

1965, printed later

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.965

Human Generated Data

Title

Untitled (tossing the bouquet, Brookline, Massachusetts)

People

Artist: Samuel Cooper, American active 1950s

Date

1965, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.1
Human 99.1
Person 99.1
Person 98.6
Person 98.3
Person 97.9
Person 97.6
Person 97.1
Furniture 96.2
Chair 96.2
Person 95
Person 94.6
Crowd 92.6
Person 86.4
Audience 86.4
Person 84.2
Person 78.9
Person 76.5
People 72.5
Reception 68.2
Indoors 67.2
Coat 64.9
Clothing 64.9
Overcoat 64.9
Suit 64.9
Apparel 64.9
Room 61.2
Hall 57.9
Reception Room 57.4
Waiting Room 57.4
Person 52
Person 44.9

Imagga
created on 2021-12-14

teacher 84.6
educator 57.8
professional 46.5
person 43.1
adult 36.1
man 33.6
people 31.8
male 25.5
student 24.4
couple 23.5
room 21.7
business 20
businessman 18.5
group 16.1
two 16.1
classroom 15.8
happy 15
education 14.7
women 14.2
desk 14.2
cheerful 13.8
blackboard 13.5
men 12.9
office 12.8
work 12.6
happiness 12.5
indoor 11.9
job 11.5
life 11.4
meeting 11.3
standing 11.3
table 11.2
senior 11.2
looking 11.2
sitting 11.2
board 10.8
handsome 10.7
interior 10.6
new 10.5
black 10.2
casual 10.2
smiling 10.1
school 10.1
worker 9.9
suit 9.9
team 9.9
portrait 9.7
indoors 9.7
nurse 9.6
patient 9.6
enrollee 9.5
communication 9.2
old 9.1
together 8.8
chair 8.7
class 8.7
corporate 8.6
manager 8.4
hand 8.4
occupation 8.2
dress 8.1
family 8
home 8
love 7.9
full length 7.8
modern 7.7
groom 7.7
bride 7.7
human 7.5
study 7.5
mature 7.4
holding 7.4
success 7.2
lifestyle 7.2
holiday 7.2
executive 7.1
smile 7.1
to 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

clothing 98.7
text 98.2
person 94.9
dance 94.6
dress 94.5
indoor 93.2
woman 91.3
floor 90.3
man 89.5
wedding dress 62.3
posing 36.5

Face analysis

Amazon

Google

AWS Rekognition

Age 20-32
Gender Female, 98%
Happy 92.2%
Calm 4.6%
Disgusted 0.6%
Angry 0.6%
Sad 0.6%
Fear 0.5%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 15-27
Gender Female, 99.4%
Happy 94.6%
Surprised 2.6%
Angry 0.8%
Confused 0.7%
Calm 0.5%
Fear 0.4%
Sad 0.4%
Disgusted 0.2%

AWS Rekognition

Age 36-54
Gender Female, 99.6%
Happy 90.7%
Calm 3.3%
Surprised 3.1%
Fear 1.2%
Confused 0.5%
Sad 0.5%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 23-35
Gender Male, 78%
Calm 71.9%
Angry 18.2%
Surprised 5.3%
Sad 1.6%
Happy 1%
Disgusted 0.8%
Confused 0.7%
Fear 0.5%

AWS Rekognition

Age 22-34
Gender Male, 89.2%
Disgusted 87.3%
Fear 3%
Angry 2.8%
Calm 2.7%
Confused 1.9%
Surprised 1%
Sad 0.9%
Happy 0.3%

AWS Rekognition

Age 45-63
Gender Male, 97.9%
Calm 95.7%
Surprised 1.1%
Sad 1%
Happy 0.7%
Angry 0.5%
Confused 0.5%
Disgusted 0.4%
Fear 0.1%

AWS Rekognition

Age 15-27
Gender Male, 79.5%
Calm 83.5%
Sad 14.5%
Angry 1.1%
Happy 0.3%
Fear 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 30-46
Gender Female, 95.1%
Sad 71.9%
Calm 22.3%
Happy 2%
Fear 1.5%
Confused 1%
Surprised 0.8%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 88.8%
Happy 32.1%
Calm 28.5%
Angry 24.3%
Surprised 5.7%
Disgusted 3%
Sad 2.5%
Confused 2%
Fear 1.9%

AWS Rekognition

Age 32-48
Gender Female, 99.6%
Happy 97.9%
Surprised 0.7%
Calm 0.3%
Fear 0.3%
Angry 0.3%
Confused 0.2%
Sad 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-37
Gender Male, 91.1%
Calm 44.7%
Surprised 33.9%
Angry 16%
Happy 2.9%
Disgusted 1.2%
Sad 0.6%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 25-39
Gender Female, 91.1%
Calm 55.2%
Sad 28%
Fear 6.8%
Surprised 5%
Angry 3.5%
Confused 0.7%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 9-19
Gender Female, 98.4%
Calm 62.4%
Surprised 16.4%
Sad 5.8%
Happy 5.3%
Fear 3.2%
Confused 2.9%
Angry 2.4%
Disgusted 1.8%

AWS Rekognition

Age 3-11
Gender Female, 75.8%
Angry 32.8%
Fear 21.8%
Sad 14.7%
Calm 13.1%
Surprised 8.8%
Happy 7.3%
Confused 0.8%
Disgusted 0.7%

AWS Rekognition

Age 8-18
Gender Male, 52.1%
Calm 47%
Surprised 15.5%
Fear 12%
Angry 9.8%
Happy 5.9%
Sad 4.7%
Disgusted 2.8%
Confused 2.3%

AWS Rekognition

Age 49-67
Gender Male, 65.6%
Sad 32.5%
Calm 28.9%
Fear 11%
Happy 8.2%
Surprised 7.4%
Confused 6%
Angry 4.6%
Disgusted 1.5%

AWS Rekognition

Age 41-59
Gender Male, 90.1%
Calm 91.1%
Surprised 3.2%
Angry 2.1%
Confused 1.1%
Sad 0.9%
Disgusted 0.6%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 32-48
Gender Male, 92.4%
Calm 80.2%
Happy 6.9%
Sad 4.7%
Angry 2.6%
Confused 2.5%
Surprised 2.3%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 22-34
Gender Female, 99.6%
Calm 83%
Happy 5.3%
Surprised 3.1%
Sad 2.6%
Angry 1.9%
Fear 1.6%
Disgusted 1.4%
Confused 1.2%

AWS Rekognition

Age 15-27
Gender Male, 65.5%
Calm 93.5%
Sad 2.5%
Confused 1.4%
Angry 1.3%
Happy 0.7%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Female, 77.4%
Calm 88.5%
Happy 7.8%
Sad 1%
Angry 0.9%
Surprised 0.7%
Fear 0.6%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 27-43
Gender Male, 85.8%
Calm 59.5%
Happy 27%
Sad 6.4%
Angry 2.6%
Confused 1.8%
Surprised 1.3%
Fear 0.7%
Disgusted 0.6%

AWS Rekognition

Age 16-28
Gender Male, 91.1%
Happy 68.3%
Calm 18.3%
Sad 3.9%
Angry 3.4%
Surprised 2.3%
Confused 1.4%
Fear 1.4%
Disgusted 1%

AWS Rekognition

Age 34-50
Gender Male, 75.9%
Calm 65.9%
Surprised 23.7%
Fear 3.3%
Sad 3.2%
Confused 1.7%
Angry 1%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 14-26
Gender Female, 95.4%
Happy 59.6%
Calm 12.5%
Fear 6.4%
Angry 6.1%
Confused 5.8%
Surprised 4.6%
Sad 3.2%
Disgusted 1.8%

AWS Rekognition

Age 24-38
Gender Female, 95.4%
Happy 88.1%
Calm 8.8%
Sad 1.2%
Confused 0.9%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 19-31
Gender Male, 68.7%
Fear 67.7%
Sad 11.6%
Calm 10.1%
Happy 3.7%
Surprised 3.1%
Angry 2.5%
Confused 0.9%
Disgusted 0.4%

AWS Rekognition

Age 36-54
Gender Male, 99.5%
Calm 63.8%
Happy 27.5%
Angry 3.7%
Sad 2.5%
Fear 0.8%
Surprised 0.7%
Confused 0.6%
Disgusted 0.3%

AWS Rekognition

Age 27-43
Gender Male, 94.6%
Calm 61.8%
Sad 23.5%
Happy 5.7%
Angry 2.8%
Confused 2.7%
Surprised 2.5%
Fear 0.6%
Disgusted 0.3%

AWS Rekognition

Age 72-86
Gender Female, 98.2%
Calm 71.4%
Sad 13.4%
Surprised 7.1%
Angry 4.7%
Happy 1.2%
Fear 1.1%
Confused 0.7%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Male, 94.2%
Calm 95.8%
Angry 2.2%
Surprised 0.6%
Happy 0.6%
Sad 0.3%
Fear 0.3%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 47-65
Gender Male, 99.1%
Calm 91.4%
Happy 2.9%
Surprised 1.6%
Angry 1.2%
Sad 1.2%
Confused 1.1%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 23-37
Gender Female, 91.8%
Calm 68.3%
Surprised 11.1%
Happy 5.3%
Sad 5%
Fear 3.2%
Confused 2.6%
Angry 2.5%
Disgusted 2%

AWS Rekognition

Age 48-66
Gender Male, 71.8%
Calm 69.3%
Surprised 11.7%
Sad 7.5%
Confused 4.3%
Fear 3%
Angry 2.2%
Happy 1.5%
Disgusted 0.5%

AWS Rekognition

Age 23-37
Gender Male, 99.1%
Happy 97.9%
Calm 1.6%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 22-34
Gender Female, 73.9%
Calm 53.5%
Sad 30%
Fear 3.8%
Surprised 3.8%
Confused 3%
Happy 2.9%
Angry 2.4%
Disgusted 0.6%

AWS Rekognition

Age 26-40
Gender Male, 51.6%
Happy 97.9%
Angry 0.7%
Calm 0.5%
Fear 0.3%
Surprised 0.3%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 22-34
Gender Female, 91.8%
Confused 45.7%
Calm 26.9%
Happy 7.2%
Disgusted 6.4%
Surprised 5.1%
Sad 5.1%
Fear 2.8%
Angry 0.8%

AWS Rekognition

Age 34-50
Gender Male, 54.8%
Sad 86.9%
Calm 11.2%
Angry 0.7%
Fear 0.6%
Happy 0.3%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-37
Gender Male, 50.6%
Sad 45.7%
Happy 14.7%
Calm 12%
Fear 10.5%
Angry 9.4%
Surprised 3.4%
Confused 3.3%
Disgusted 1.1%

AWS Rekognition

Age 51-69
Gender Female, 71.6%
Calm 84.5%
Happy 11.2%
Sad 2%
Angry 0.8%
Surprised 0.8%
Confused 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 25-39
Gender Female, 55.9%
Calm 46.5%
Sad 35.6%
Angry 9.3%
Happy 4.3%
Fear 3.1%
Confused 0.7%
Disgusted 0.4%
Surprised 0.2%

AWS Rekognition

Age 29-45
Gender Male, 79.6%
Happy 38%
Surprised 21.4%
Sad 18.3%
Fear 13.1%
Calm 5.6%
Confused 2.2%
Angry 1.2%
Disgusted 0.2%

AWS Rekognition

Age 33-49
Gender Female, 62.5%
Calm 78%
Happy 8.7%
Sad 4.4%
Angry 3.2%
Disgusted 1.9%
Fear 1.7%
Confused 1.2%
Surprised 0.8%

AWS Rekognition

Age 26-42
Gender Female, 86.5%
Sad 64.5%
Happy 19.9%
Calm 11.5%
Fear 3%
Angry 0.6%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 4-14
Gender Male, 85.3%
Sad 60.4%
Calm 35.7%
Confused 1.4%
Fear 1.4%
Angry 0.7%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 28-44
Gender Female, 68.9%
Calm 93.2%
Sad 2.4%
Angry 1.8%
Happy 1.4%
Confused 0.4%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Chair 96.2%

Captions

Microsoft

a group of people posing for a photo 89.1%
a group of people standing in a room 89%
a group of people in a room 88.9%

Text analysis

Amazon

55%
(120)
P132

Google

(120)
PI32
(120) PI32 55%
55%