Human Generated Data

Title

Untitled (group of cildren leaning over counter with sodas)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7013

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of cildren leaning over counter with sodas)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7013

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Person 99.9
Human 99.9
Person 99.2
Person 97.7
Person 97
Person 96.6
Person 95.6
Person 95.6
Person 93.3
Restaurant 87.7
Building 83.7
Classroom 81.6
Room 81.6
School 81.6
Indoors 81.6
Cafeteria 81
Person 80.5
Factory 80
Person 79.6
Person 73.5
Beer 63.7
Beverage 63.7
Alcohol 63.7
Drink 63.7
Workshop 60.9
Person 60.5
Couch 56.2
Furniture 56.2
Beer 55.2
Person 48.4

Clarifai
created on 2025-01-10

people 99.8
group 99.6
group together 98.7
child 97.4
man 95.8
woman 95
boy 95
adult 94.8
many 94.7
recreation 93.9
room 93.8
several 91.2
monochrome 90.5
education 90.3
war 86.9
music 86.5
furniture 86.4
school 85.9
five 85
administration 83.9

Imagga
created on 2022-03-12

man 42
meeting 39.6
people 36.8
male 34.1
group 33.9
business 33.4
table 33
office 32.2
businessman 31.8
person 31.4
team 31.4
classroom 28
room 27.4
businesswoman 27.3
sitting 25.8
teamwork 25
men 24.9
work 23.5
laptop 23.3
smiling 23.1
working 23
corporate 22.3
executive 22.2
computer 21.7
happy 21.3
together 21
communication 21
teacher 20.5
professional 19.4
indoors 19.3
desk 19.1
adult 18.6
women 18.2
businesspeople 18
suit 18
conference 17.6
education 17.3
presentation 16.8
musical instrument 16.6
colleagues 16.5
discussion 15.6
talking 15.2
photographer 15.2
student 14.4
job 14.2
interior 14.2
lifestyle 13.7
indoor 13.7
restaurant 13.2
couple 13.1
manager 13
smile 12.8
workplace 12.4
cheerful 12.2
holding 11.6
chair 11.5
brass 11.3
success 11.3
modern 11.2
looking 11.2
technology 11.1
happiness 11
board 10.9
collaboration 10.8
students 10.7
partners 10.7
cooperation 10.6
learning 10.3
coffee 10.2
two 10.2
successful 10.1
worker 10
confident 10
stringed instrument 10
discussing 9.8
wind instrument 9.8
gesture 9.5
females 9.5
paper 9.4
friends 9.4
study 9.3
training 9.2
occupation 9.2
portrait 9.1
seminar 8.8
staff 8.8
planning 8.7
diversity 8.6
college 8.5
plan 8.5
school 8.5
enjoyment 8.4
showing 8.4
document 8.4
educator 8.3
phone 8.3
hall 8.2
life 8
home 8
debate 7.9
explaining 7.9
coworkers 7.9
businessmen 7.8
device 7.8
color 7.8
bowed stringed instrument 7.7
busy 7.7
30s 7.7
exam 7.7
togetherness 7.6
contemporary 7.5
to 7.1
glass 7

Google
created on 2022-03-12

Photograph 94.3
Black 89.6
Black-and-white 85.8
Style 84.1
Table 80.7
Monochrome 80.6
Monochrome photography 77.6
Snapshot 74.3
Curtain 72.7
T-shirt 70.7
Event 70.2
Building 68.9
Class 67
Art 66.3
Cooking 65.9
Machine 65.4
Room 65.2
Child 61.5
School 55.5
Photo caption 55.3

Microsoft
created on 2022-03-12

indoor 98.6
person 98.5
table 92.7
clothing 74.3
text 71
man 68.9
group 60.2
people 59.1
computer 50.4
restaurant 18.3
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Sad 84.5%
Calm 9.3%
Happy 2.2%
Confused 1.9%
Disgusted 0.6%
Fear 0.6%
Angry 0.4%
Surprised 0.4%

AWS Rekognition

Age 6-14
Gender Male, 98.7%
Happy 89.1%
Surprised 7.3%
Sad 1.1%
Calm 0.6%
Fear 0.5%
Disgusted 0.5%
Angry 0.4%
Confused 0.4%

AWS Rekognition

Age 37-45
Gender Female, 100%
Calm 60.8%
Angry 15.5%
Happy 11.3%
Sad 6.7%
Disgusted 2.4%
Surprised 1.9%
Fear 1%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 94.5%
Surprised 4.7%
Fear 0.2%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Calm 0.1%

AWS Rekognition

Age 6-14
Gender Female, 98.4%
Calm 94.9%
Sad 3.7%
Fear 0.5%
Confused 0.4%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 16-24
Gender Female, 100%
Sad 97.3%
Calm 1%
Confused 0.5%
Fear 0.4%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%
Surprised 0.1%

AWS Rekognition

Age 10-18
Gender Female, 99.5%
Fear 51%
Calm 26.3%
Sad 11.7%
Confused 4.9%
Surprised 2.6%
Disgusted 1.3%
Angry 1.3%
Happy 0.9%

AWS Rekognition

Age 18-26
Gender Male, 99.5%
Calm 86.5%
Sad 8.2%
Fear 2.9%
Confused 1.3%
Surprised 0.5%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 1-7
Gender Female, 98%
Sad 59.5%
Calm 35%
Happy 2.1%
Fear 0.9%
Confused 0.8%
Angry 0.7%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 19-27
Gender Male, 73.9%
Sad 95.5%
Calm 3.8%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Sad 80.3%
Confused 10.9%
Calm 4.4%
Disgusted 2.5%
Happy 0.8%
Surprised 0.5%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 12-20
Gender Male, 92.5%
Fear 31.9%
Calm 28.4%
Confused 13.5%
Surprised 7.9%
Sad 6.1%
Disgusted 4.4%
Happy 4%
Angry 3.7%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Beer
Person 99.9%
Person 99.2%
Person 97.7%
Person 97%
Person 96.6%
Person 95.6%
Person 95.6%
Person 93.3%
Person 80.5%
Person 79.6%
Person 73.5%
Person 60.5%
Person 48.4%
Beer 63.7%
Beer 55.2%

Categories

Imagga

people portraits 76.6%
events parties 22.8%

Text analysis

Amazon

22433
ARE
ARE DUE!
DUE!
COLA
-
CAROS
MEMBERSHIP CAROS
MEMBERSHIP
ROYALOR
Royal
ROHAL
W
STRENG
TEM
Total

Google

22433 MEMBERSHP CHC ARE DUE HKE ALO
22433
MEMBERSHP
CHC
ARE
DUE
HKE
ALO