Human Generated Data

Title

Untitled (group portrait around table)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1130

Human Generated Data

Title

Untitled (group portrait around table)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Room 100
Classroom 100
School 100
Indoors 100
Person 98.1
Human 98.1
Person 97.7
Person 97.7
Person 97.6
Person 97.3
Person 95.4
Person 95.2
Person 94.6
Person 94.3
Person 93.2
Person 90.4
Person 85.1
Person 84.5
Chair 80.8
Furniture 80.8
Person 80.1
Chair 80.1
Person 73.1
Chair 69.7
Person 68.7
Person 65.1
Person 61.4
Chair 60.4
Person 58.4
Chair 55.5
Chair 52.3
Person 51.9

Imagga
created on 2022-01-23

brass 80.8
classroom 68.1
wind instrument 62.5
room 60.5
musical instrument 45
people 34.6
man 34.2
male 34
person 32.9
group 25.8
adult 25.4
trombone 24.8
men 22.3
businessman 22.1
table 20.8
business 20.6
happy 19.4
teacher 18
smiling 17.3
meeting 16.9
professional 16.4
chair 16.3
sitting 16.3
office 16
indoors 15.8
women 15.8
businesswoman 15.4
smile 15
education 14.7
lifestyle 14.4
team 14.3
together 14
executive 13.8
cheerful 13.8
portrait 13.6
home 13.5
happiness 13.3
student 13.2
desk 13.2
couple 13.1
casual 12.7
students 12.7
family 12.4
interior 12.4
boy 12.2
study 12.1
confident 11.8
worker 11.6
cornet 11.5
businesspeople 11.4
corporate 11.2
teamwork 11.1
work 11
indoor 10.9
learning 10.3
school 10.1
holding 9.9
handsome 9.8
attractive 9.8
conference 9.8
standing 9.5
baritone 9.2
suit 9
fun 9
diverse 8.8
computer 8.8
class 8.7
talking 8.5
enjoying 8.5
friends 8.4
friendship 8.4
modern 8.4
manager 8.4
presentation 8.4
training 8.3
girls 8.2
looking 8
to 8
working 7.9
black 7.8
child 7.7
diversity 7.7
laughing 7.6
communication 7.6
joy 7.5
company 7.4
occupation 7.3
laptop 7.3
board 7.2
color 7.2
music 7.1
job 7.1

Google
created on 2022-01-23

Dress 85
Crew 76.4
Event 73.9
Team 69.9
Vintage clothing 69.2
Class 67.7
Room 64.2
Suit 60.5
Uniform 54.8
Sitting 54.1
History 53.7
Child 53.5
Family reunion 50.8

Microsoft
created on 2022-01-23

person 97.6
wall 96.9
text 94.4
group 90.2
indoor 86.2
furniture 83.1
table 77.9
posing 77.6
chair 77.4
musical instrument 71.2
clothing 68.6
old 62.2
team 26.8
concert band 12.7

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 100%
Happy 82.5%
Calm 10.9%
Surprised 3.5%
Angry 1.3%
Confused 0.6%
Sad 0.5%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 0-6
Gender Female, 54.4%
Calm 89.6%
Happy 7.1%
Angry 1.2%
Confused 0.8%
Sad 0.7%
Fear 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 96%
Sad 0.9%
Angry 0.8%
Confused 0.7%
Surprised 0.7%
Happy 0.5%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Calm 98%
Sad 1%
Disgusted 0.2%
Happy 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 96.2%
Surprised 1.2%
Angry 1%
Calm 0.5%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 30-40
Gender Male, 100%
Happy 63.5%
Surprised 11.2%
Calm 10.1%
Fear 8.5%
Angry 2.3%
Confused 1.7%
Disgusted 1.5%
Sad 1.2%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 96.5%
Disgusted 0.9%
Angry 0.7%
Sad 0.5%
Happy 0.5%
Surprised 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 10-18
Gender Female, 100%
Happy 99.4%
Surprised 0.2%
Calm 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 56-64
Gender Female, 100%
Happy 99.1%
Surprised 0.3%
Fear 0.2%
Angry 0.1%
Calm 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 16-22
Gender Female, 100%
Happy 82.6%
Calm 8.2%
Surprised 3.4%
Disgusted 1.5%
Confused 1.2%
Angry 1.1%
Fear 1%
Sad 0.9%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.3%
Sad 0.3%
Confused 0.1%
Angry 0.1%
Happy 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Female, 100%
Happy 95.3%
Angry 0.9%
Calm 0.9%
Disgusted 0.8%
Fear 0.8%
Surprised 0.8%
Sad 0.3%
Confused 0.2%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 99.8%
Surprised 0.1%
Calm 0.1%
Confused 0%
Fear 0%
Angry 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 88.9%
Angry 4.4%
Confused 3.3%
Sad 1.5%
Fear 0.6%
Surprised 0.5%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 54-64
Gender Female, 100%
Calm 99.6%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%
Disgusted 0%
Sad 0%
Happy 0%

AWS Rekognition

Age 43-51
Gender Male, 100%
Happy 93.2%
Sad 3.8%
Calm 0.9%
Confused 0.5%
Fear 0.5%
Disgusted 0.4%
Surprised 0.4%
Angry 0.3%

AWS Rekognition

Age 54-62
Gender Female, 100%
Happy 88%
Surprised 2.9%
Angry 2.6%
Calm 2.4%
Fear 1.5%
Sad 0.9%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 40-48
Gender Female, 100%
Happy 99.5%
Surprised 0.1%
Calm 0.1%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Female, 70.2%
Calm 72%
Happy 14.9%
Confused 3%
Sad 2.5%
Disgusted 2.2%
Fear 1.9%
Angry 1.9%
Surprised 1.7%

AWS Rekognition

Age 22-30
Gender Male, 100%
Angry 73.6%
Happy 13.3%
Confused 4.6%
Calm 4.4%
Disgusted 2.4%
Surprised 1%
Sad 0.5%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Female, 100%
Happy 88.8%
Angry 4.6%
Calm 2.6%
Sad 1.5%
Surprised 1.2%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 6-12
Gender Female, 98.7%
Happy 42.3%
Calm 24.6%
Fear 15%
Confused 5.6%
Surprised 4.8%
Sad 3.5%
Angry 3.2%
Disgusted 1.1%

AWS Rekognition

Age 16-24
Gender Female, 100%
Calm 82.9%
Fear 14%
Surprised 1.4%
Angry 0.7%
Disgusted 0.4%
Confused 0.3%
Sad 0.2%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.4%
Calm 99.5%
Angry 0.2%
Sad 0.2%
Confused 0%
Fear 0%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 0-3
Gender Female, 100%
Calm 99%
Sad 0.6%
Surprised 0.1%
Confused 0.1%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 0-4
Gender Female, 99.6%
Calm 51.2%
Sad 32.3%
Confused 6.6%
Happy 3.5%
Angry 2.5%
Disgusted 1.3%
Surprised 1.3%
Fear 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Chair 80.8%

Captions

Microsoft

a group of people posing for a photo 92.8%
a group of people posing for the camera 92.7%
a group of people posing for a picture 92.6%

Text analysis

Amazon

PROOF
weeds

Google

PROOF
PROOF