Human Generated Data

Title

Religious Agencies, Salvation Army: Germany. Salvation Army work for Drunkards: Drunkards' Brigade, Rescuing a drunkard from the street, Berlin.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.267.1

Human Generated Data

Title

Religious Agencies, Salvation Army: Germany. Salvation Army work for Drunkards: Drunkards' Brigade, Rescuing a drunkard from the street, Berlin.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Officer 99.9
Military 99.9
Military Uniform 99.9
Human 99.9
Person 99.7
Person 99.2
Person 99.1
Person 99
Person 97.6
Captain 97.4
Bench 96.1
Furniture 96.1
Shoe 56.7
Clothing 56.7
Footwear 56.7
Apparel 56.7
Sailor Suit 56.4
Soldier 56.3
Shoe 53.8

Imagga
created on 2022-06-25

military uniform 68.4
uniform 58.2
clothing 43.8
helmet 32.7
consumer goods 27.6
armor plate 23
man 21.5
people 20.1
covering 19.7
old 18.8
statue 18.2
male 15.6
adult 14.5
sculpture 14.1
plate 13.9
commodity 13.5
religion 13.4
person 13
ancient 13
soldier 12.7
history 12.5
monument 12.1
travel 12
architecture 11.7
art 11.3
group 11.3
kin 10.9
vintage 10.7
historical 10.3
women 10.3
tourism 9.9
family 9.8
antique 9.7
two 9.3
historic 9.2
army 8.8
military 8.7
culture 8.5
stone 8.4
black 8.4
portrait 8.4
life 8.4
traditional 8.3
fashion 8.3
world 8
room 8
home 8
sitting 7.7
men 7.7
war 7.7
god 7.6
shield 7.6
happy 7.5
religious 7.5
city 7.5
lady 7.3
business 7.3
decoration 7.2
lifestyle 7.2
dress 7.2
holiday 7.2
happiness 7

Google
created on 2022-06-25

Coat 88.9
Standing 86.4
Hat 83.5
Motor vehicle 80.3
Door 79
Military person 77.6
Military uniform 76.1
Vintage clothing 75.9
Blazer 74.9
Suit 73.2
Military officer 73.1
Uniform 71.1
Bench 70.5
Non-commissioned officer 66
History 65.7
Crew 65.1
Collar 63.9
Team 62.9
Classic 61
Military organization 59.5

Microsoft
created on 2022-06-25

clothing 97.8
person 96.5
man 93.7
old 72.8
posing 56
funeral 52.8
dressed 43.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-20
Gender Male, 99.1%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 97.6%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Angry 0.6%
Confused 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 39.1%
Surprised 22.7%
Angry 21.6%
Confused 11.5%
Fear 6.3%
Happy 5.5%
Sad 2.8%
Disgusted 2.1%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 97.9%
Surprised 6.4%
Fear 6%
Sad 2.3%
Confused 0.7%
Disgusted 0.3%
Angry 0.2%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 98.2%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Bench 96.1%
Shoe 56.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 90.6%
a vintage photo of a group of people posing for a picture 90.5%
a vintage photo of a group of people standing in front of a building 89.3%

Text analysis

Amazon

4

Google

utt at STO ATTE wate
utt
at
STO
ATTE
wate