Human Generated Data

Title

Untitled (group of debutantes)

Date

c. 1966

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19248

Human Generated Data

Title

Untitled (group of debutantes)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1966

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Poster 99.9
Advertisement 99.9
Human 99.3
Person 99.1
Person 98.7
Person 98.5
Person 98.3
Person 96.9
Person 96
Person 95.3
Person 92.6
Person 91.2
Person 87.5
Astronaut 86.3
Person 85.6
Person 83.8
Person 79.4
Person 79
Person 78.4
Person 74.6
Person 69.4
People 65.1
Person 48

Imagga
created on 2022-02-25

male 21.3
people 20.6
man 20
violin 17.7
person 16.3
stringed instrument 15.4
bowed stringed instrument 15.2
musical instrument 14.2
silhouette 14.1
business 13.3
black 12.6
men 12
grunge 10.2
style 9.6
art 9.3
office 9.2
modern 9.1
vintage 9.1
old 9
paint 9
working 8.8
equipment 8.5
room 8.5
design 8.4
sport 8.4
device 8.3
adult 8.1
building 8.1
table 8
worker 8
drawing 7.9
urban 7.9
text 7.8
work 7.8
glass 7.8
clothing 7.6
instrument 7.5
fun 7.5
professional 7.4
retro 7.4
aged 7.2
dress 7.2
tool 7.2
paper 7.1
businessman 7.1
medical 7.1
architecture 7

Google
created on 2022-02-25

Dress 88.5
Suit 74
Uniform 70.5
Vintage clothing 69.6
Event 68.8
Crew 65.5
Stock photography 63.7
Team 63.2
Room 62.4
Font 61.2
History 60
Family reunion 57.1
Art 54.4
Family 51.5

Microsoft
created on 2022-02-25

text 99.6
person 96.4
clothing 94.1
posing 65.3
man 53.3
woman 51.9
picture frame 8.3

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Female, 100%
Sad 83.8%
Confused 10.4%
Calm 3.1%
Surprised 0.8%
Fear 0.7%
Disgusted 0.5%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Calm 44.1%
Happy 43.1%
Disgusted 3.4%
Sad 2.9%
Confused 2.5%
Surprised 1.7%
Angry 1.5%
Fear 0.8%

AWS Rekognition

Age 27-37
Gender Female, 100%
Happy 98%
Confused 1.3%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Calm 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 97.9%
Confused 1%
Surprised 0.3%
Angry 0.2%
Fear 0.2%
Calm 0.2%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 100%
Happy 99.9%
Angry 0%
Calm 0%
Sad 0%
Disgusted 0%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 92.3%
Happy 99.3%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Calm 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 100%
Calm 82.7%
Sad 10.8%
Happy 2.7%
Angry 1.3%
Confused 0.9%
Surprised 0.9%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 18-24
Gender Female, 98.3%
Happy 99.3%
Surprised 0.2%
Fear 0.1%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Calm 0.1%

AWS Rekognition

Age 18-24
Gender Female, 100%
Happy 99.3%
Surprised 0.3%
Fear 0.1%
Calm 0.1%
Sad 0.1%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 40.2%
Happy 27.3%
Sad 10.3%
Confused 9.7%
Angry 4.6%
Surprised 4.2%
Disgusted 2.2%
Fear 1.6%

AWS Rekognition

Age 16-22
Gender Female, 99.9%
Calm 55.4%
Happy 32.1%
Sad 7.8%
Surprised 1.1%
Confused 1%
Disgusted 1%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Male, 93.6%
Calm 99.7%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Sad 0%
Angry 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 23-31
Gender Female, 100%
Fear 59.2%
Happy 30.6%
Surprised 4.4%
Angry 1.7%
Calm 1.7%
Confused 0.8%
Disgusted 0.8%
Sad 0.7%

AWS Rekognition

Age 25-35
Gender Female, 99.6%
Calm 95.4%
Sad 3.3%
Angry 0.4%
Confused 0.3%
Surprised 0.3%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 97.3%
Sad 1.5%
Happy 0.5%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Female, 90.3%
Calm 99.2%
Happy 0.5%
Confused 0.1%
Surprised 0%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 93.5%
Surprised 3.1%
Sad 1%
Angry 0.8%
Confused 0.6%
Happy 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Female, 89.9%
Calm 99.4%
Angry 0.3%
Sad 0.1%
Happy 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 99.8%
Angry 0.1%
Sad 0%
Disgusted 0%
Fear 0%
Surprised 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 18-24
Gender Female, 100%
Happy 99.7%
Sad 0.1%
Fear 0.1%
Calm 0%
Angry 0%
Surprised 0%
Disgusted 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.9%
Person 99.1%

Captions

Microsoft

a group of people posing for a photo 85.5%
a group of people posing for a picture 85.4%
a group of people posing for the camera 85.3%

Text analysis

Amazon

133
de

Google

133
133