Human Generated Data

Title

Untitled (four long tables of diners at Lockhart High School football banquet)
Date

1953
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3178

Human Generated Data

Title

Untitled (four long tables of diners at Lockhart High School football banquet)

People

Artist: Harry Annas, American 1897 - 1980

Date

1953

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3178

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 98.2
Person 98.1
Person 97.7
Indoors 97.3
Chair 97.2
Furniture 97.2
Room 97.1
Person 96.8
Person 95.8
Crowd 93.1
Chair 91.6
Person 91.2
Person 90.2
Person 90.2
Person 86.7
Person 86.4
Musician 86.4
Musical Instrument 86.4
Interior Design 83.4
Person 81.9
People 79.4
Person 78.8
Person 74.6
Restaurant 73.9
Leisure Activities 72.1
Audience 70.2
Theater 67.9
Music Band 67.3
Chair 66.9
Concert 66.5
Stage 62.3
Hall 62
Table 61.8
Classroom 59
School 59
Plant 58.7
Dining Table 57.2
Suit 56.9
Clothing 56.9
Coat 56.9
Overcoat 56.9
Apparel 56.9
Photography 56.7
Photo 56.7
Cafeteria 55.3
Bedroom 55.3

Clarifai
created on 2023-10-26

people 99.7
many 99.6
group 98.7
furniture 98.2
room 97.8
music 95.2
group together 95
indoors 94.8
crowd 94.8
audience 93
chair 92.8
musician 91.2
woman 90.9
man 88.8
adult 88.1
ceremony 86.9
wedding 86.1
leader 85.7
seat 85
wear 84.8

Imagga
created on 2022-01-22

people 27.3
stage 25.7
person 25
musical instrument 23.7
man 23.5
group 22.6
teacher 21.3
table 20.8
interior 19.4
business 18.8
male 18.4
hall 17.6
bowed stringed instrument 17
room 16.2
chair 16.1
businessman 15.9
adult 15.8
musician 15.8
stringed instrument 15.5
music 15.5
office 15.3
professional 15
singer 14.7
modern 14.7
indoor 14.6
concert 14.6
platform 14.5
restaurant 13.7
wind instrument 13.2
design 12.9
work 12.5
bass 12.5
indoors 12.3
women 11.9
meeting 11.3
speaker 11.3
men 11.2
guitar 10.9
communication 10.9
businesswoman 10.9
education 10.4
style 10.4
corporate 10.3
light 10
team 9.8
educator 9.8
band 9.7
violin 9.7
musical 9.6
rock 9.5
party 9.4
house 9.2
occupation 9.2
student 9.1
confident 9.1
lifestyle 8.7
crowd 8.6
performance 8.6
drinking 8.6
furniture 8.6
performer 8.5
businesspeople 8.5
desk 8.5
black 8.4
worker 8.3
inside 8.3
entertainment 8.3
silhouette 8.3
holding 8.2
computer 8
classroom 8
home 8
job 8
glass 7.8
sitting 7.7
learning 7.5
executive 7.5
study 7.5
star 7.4
blackboard 7.4
board 7.2
handsome 7.1
brass 7.1
working 7.1
device 7
architecture 7

Google
created on 2022-01-22

Photograph 94.2
Black 89.6
Chair 87.6
Black-and-white 85.9
Style 84
Monochrome 76.4
Monochrome photography 75.6
Event 74.4
Snapshot 74.3
Crowd 72.2
Room 68.3
Suit 67.9
Stock photography 62.8
Entertainment 62
Ornament 61.7
Party supply 59.6
Team 58.7
Chandelier 56.9
Fun 55.6
Light fixture 54.7

Microsoft
created on 2022-01-22

person 96.5
text 88.4
people 84.1
clothing 80.7
table 64.4
group 61.5
crowd 58.5
black and white 56.7
man 52.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 63.9%
Sad 64.6%
Calm 25.2%
Happy 7%
Confused 1.2%
Angry 0.7%
Surprised 0.5%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 46%
Sad 41.9%
Confused 5.6%
Angry 3.1%
Happy 2.1%
Disgusted 0.7%
Surprised 0.6%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 80.1%
Calm 94.1%
Happy 2.3%
Sad 1.8%
Confused 1%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 92.4%
Calm 97.6%
Sad 0.9%
Surprised 0.8%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.8%
Calm 96.4%
Sad 1.1%
Surprised 0.7%
Angry 0.6%
Happy 0.3%
Confused 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Male, 93.5%
Sad 59.7%
Calm 34.7%
Confused 2%
Angry 1.9%
Disgusted 0.7%
Happy 0.6%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Female, 96.4%
Happy 33.8%
Sad 21.5%
Calm 18.5%
Surprised 7.8%
Fear 6.6%
Angry 4.9%
Disgusted 3.8%
Confused 3.1%

AWS Rekognition

Age 48-54
Gender Male, 98.6%
Calm 49.4%
Happy 29.6%
Sad 10.7%
Surprised 4%
Confused 3.2%
Disgusted 2%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 36-44
Gender Male, 98.9%
Calm 94%
Sad 2.1%
Confused 1.9%
Happy 1.1%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Female, 65.7%
Fear 48.3%
Calm 31.1%
Sad 6.5%
Happy 6.3%
Angry 3.7%
Disgusted 1.9%
Confused 1.1%
Surprised 1.1%

AWS Rekognition

Age 27-37
Gender Male, 87.7%
Calm 93.3%
Angry 2.7%
Happy 1.4%
Sad 1.1%
Disgusted 0.6%
Surprised 0.5%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 18-24
Gender Female, 95.4%
Calm 75.5%
Sad 16.1%
Happy 3.4%
Fear 1.8%
Angry 1.3%
Confused 1.2%
Disgusted 0.5%
Surprised 0.2%

AWS Rekognition

Age 47-53
Gender Male, 55.2%
Happy 84.6%
Calm 12.9%
Surprised 0.6%
Sad 0.6%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 28-38
Gender Female, 98%
Calm 77.6%
Sad 11.2%
Happy 6.6%
Confused 2.9%
Surprised 0.5%
Disgusted 0.5%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 37-45
Gender Male, 82%
Calm 96.1%
Sad 1.2%
Happy 0.9%
Confused 0.6%
Surprised 0.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Female, 52%
Calm 83%
Sad 8.1%
Happy 2.9%
Confused 2.4%
Disgusted 2.3%
Surprised 0.7%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Female, 52.4%
Calm 88.6%
Angry 4.7%
Sad 4.4%
Happy 0.6%
Surprised 0.5%
Disgusted 0.5%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Female, 54.4%
Calm 75.7%
Sad 17.4%
Angry 2.6%
Confused 1.6%
Fear 0.8%
Happy 0.8%
Surprised 0.7%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Female, 63.8%
Calm 93.4%
Sad 2%
Confused 1.1%
Surprised 1%
Disgusted 0.9%
Happy 0.7%
Angry 0.5%
Fear 0.5%

AWS Rekognition

Age 23-33
Gender Female, 89.6%
Calm 89.4%
Surprised 2.7%
Happy 2.6%
Confused 1.8%
Sad 1.4%
Angry 0.8%
Fear 0.7%
Disgusted 0.6%

AWS Rekognition

Age 18-24
Gender Female, 87.8%
Calm 61.1%
Happy 19.6%
Sad 7.7%
Fear 3.8%
Angry 2.6%
Confused 2.3%
Disgusted 1.6%
Surprised 1.3%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 66.9%
Happy 23.4%
Sad 3%
Confused 2.4%
Surprised 1.7%
Disgusted 1.3%
Angry 0.7%
Fear 0.5%

AWS Rekognition

Age 18-26
Gender Male, 72.3%
Calm 89.9%
Happy 3.5%
Confused 2.5%
Sad 2.4%
Angry 0.6%
Disgusted 0.5%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 16-24
Gender Female, 74.3%
Calm 75.5%
Sad 11%
Confused 4.9%
Angry 3%
Fear 2.3%
Surprised 1.4%
Happy 1.2%
Disgusted 0.8%

AWS Rekognition

Age 20-28
Gender Male, 90.6%
Calm 93.9%
Sad 1.9%
Happy 1.5%
Angry 1.1%
Disgusted 0.7%
Fear 0.4%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 30-40
Gender Female, 99%
Calm 36.5%
Happy 25.8%
Sad 15.5%
Disgusted 5.3%
Confused 5.3%
Angry 4.6%
Surprised 4%
Fear 3.1%

AWS Rekognition

Age 18-26
Gender Female, 95.2%
Calm 52.4%
Sad 28.6%
Angry 6%
Confused 3.9%
Disgusted 2.8%
Fear 2.6%
Happy 2.5%
Surprised 1.2%

AWS Rekognition

Age 11-19
Gender Male, 88.1%
Sad 39.3%
Calm 35.4%
Fear 16.3%
Angry 2.9%
Happy 2.6%
Disgusted 2.1%
Confused 1%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person
Chair
Person 98.1%
Person 97.7%
Person 96.8%
Person 95.8%
Person 91.2%
Person 90.2%
Person 90.2%
Person 86.7%
Person 86.4%
Person 81.9%
Person 78.8%
Person 74.6%
Chair 97.2%
Chair 91.6%
Chair 66.9%

Categories

Imagga

interior objects 95.3%
streetview architecture 3.2%
cars vehicles 1.1%

Text analysis

Google

MJI7--YT3RA°2-- XAGO
MJI7--YT3RA°2--
XAGO