Human Generated Data

Title

Untitled (group portrait of Sarasota Bank & Trust Company employees)
Date

1969
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11300
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group portrait of Sarasota Bank & Trust Company employees)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1969

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 98.9
Apparel 98.9
Person 98.3
Human 98.3
Person 98
Person 97.1
Person 96.2
Person 96.1
Person 95.5
Tie 94.7
Accessories 94.7
Accessory 94.7
Person 94.7
Person 94.6
Dress 92.6
Person 88.8
Tie 87.1
Person 85.8
Suit 77.7
Coat 77.7
Overcoat 77.7
Person 75.1
Shirt 64.4
Female 63.2
Floor 63
People 62.2
Evening Dress 59.8
Fashion 59.8
Gown 59.8
Robe 59.8
Chair 59.2
Furniture 59.2
Sleeve 57.1
Person 56.5
Flooring 55.4

Imagga
created on 2022-01-09

nurse 100
man 36.9
people 33.4
person 32.2
professional 31.9
doctor 31.9
male 31.2
medical 30
coat 29.1
adult 26.6
hospital 25.6
lab coat 25.5
stethoscope 22.3
job 22.1
brass 22.1
medicine 22
health 21.5
happy 21.3
uniform 20.1
cornet 19.6
business 19.4
portrait 18.8
businessman 18.5
occupation 17.4
team 17
wind instrument 16.9
mature 16.7
smiling 16.6
standing 16.5
smile 16.4
clinic 16.3
handsome 16
care 15.6
worker 15.5
men 15.5
group 15.3
specialist 15
patient 14.6
profession 14.3
corporate 13.7
looking 13.6
work 13.3
clothing 13.2
confident 12.7
laboratory 12.5
surgeon 12.3
friendly 11.9
day 11.8
musical instrument 11.7
clinical 11.7
practitioner 11.6
staff 11.5
human 11.2
office 11.2
suit 10.8
physician 10.7
colleagues 10.7
black 10.2
teamwork 10.2
treatment 10.1
successful 10.1
businesswoman 10
40s 9.7
working 9.7
illness 9.5
businesspeople 9.5
healthy 9.4
lifestyle 9.4
senior 9.4
bright 9.3
player 9.1
success 8.8
indoors 8.8
together 8.8
health care 8.7
full length 8.7
practice 8.7
women 8.7
30s 8.6
crowd 8.6
adults 8.5
casual 8.5
garment 8.1
associates 7.9
happiness 7.8
consultant 7.8
lab 7.8
employee 7.7
sick 7.7
modern 7.7
elderly 7.7
golfer 7.6
sport 7.4
window 7.3
exercise 7.3
copy space 7.2

Google
created on 2022-01-09

Gesture 85.3
Sleeve 84.3
Font 83.1
Monochrome 74.8
Monochrome photography 72.2
Suit 70.7
Event 70.4
Window 69.3
Team 68
Formal wear 67.1
Room 62.3
Stock photography 61.6
Service 57.5
Art 54.8
Uniform 53.2
Display device 52.4
History 52.3
Advertising 51.6
Photo caption 51.4
White-collar worker 51.2

Microsoft
created on 2022-01-09

text 95.9
person 91.9
old 78.3
posing 75.8
group 63

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Sad 79.3%
Happy 13.9%
Confused 2.4%
Angry 1.1%
Disgusted 1%
Calm 0.9%
Surprised 0.9%
Fear 0.7%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Sad 97.9%
Calm 0.4%
Confused 0.4%
Disgusted 0.3%
Surprised 0.3%
Fear 0.3%
Happy 0.3%
Angry 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Sad 98.8%
Confused 0.3%
Happy 0.3%
Fear 0.2%
Calm 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 83.3%
Happy 9.8%
Sad 4.6%
Confused 1.3%
Surprised 0.4%
Disgusted 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Happy 53.2%
Surprised 34.4%
Calm 4.1%
Sad 3.3%
Fear 1.9%
Disgusted 1.1%
Confused 1%
Angry 1%

AWS Rekognition

Age 36-44
Gender Female, 54.4%
Calm 99.4%
Happy 0.4%
Sad 0.1%
Angry 0%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Female, 62.2%
Calm 77.2%
Sad 12.1%
Happy 8.1%
Confused 1.3%
Angry 0.6%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Calm 96.2%
Happy 3%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 40-48
Gender Female, 55.6%
Calm 97.9%
Happy 0.6%
Sad 0.5%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Sad 99.4%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Happy 0.1%
Calm 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 42-50
Gender Female, 92.5%
Happy 61.8%
Calm 35.8%
Sad 0.7%
Angry 0.5%
Confused 0.4%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 42-50
Gender Male, 57.8%
Calm 72.6%
Sad 19.2%
Confused 4.9%
Happy 2.1%
Angry 0.5%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 99.5%
Happy 63.4%
Sad 24.3%
Calm 4.5%
Surprised 3.2%
Confused 1.3%
Angry 1.2%
Disgusted 1.1%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Tie 94.7%

Captions

Microsoft

a group of people posing for a photo 92.6%
a group of people posing for the camera 92.5%
a group of people posing for a picture 92.4%

Text analysis

Amazon

57216.
ROGO